-- Logs begin at Wed 2022-08-03 04:12:52 UTC, end at Wed 2022-08-03 05:33:11 UTC. -- Aug 03 05:03:52.148326 dv-cinder-851279-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 03 05:03:52.160420 dv-cinder-851279-4-iscsi devstack@n-api.service[103802]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 03 05:03:52.165861 dv-cinder-851279-4-iscsi devstack@n-api.service[103802]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 3 05:03:52 2022] *** Aug 03 05:03:52.165861 dv-cinder-851279-4-iscsi devstack@n-api.service[103802]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 03 05:03:52.165861 dv-cinder-851279-4-iscsi devstack@n-api.service[103802]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 03 05:03:52.165861 dv-cinder-851279-4-iscsi devstack@n-api.service[103802]: nodename: dv-cinder-851279-4-iscsi Aug 03 05:03:52.165861 dv-cinder-851279-4-iscsi devstack@n-api.service[103802]: machine: x86_64 Aug 03 05:03:52.165861 dv-cinder-851279-4-iscsi devstack@n-api.service[103802]: clock source: unix Aug 03 05:03:52.165861 dv-cinder-851279-4-iscsi devstack@n-api.service[103802]: pcre jit disabled Aug 03 05:03:52.165861 dv-cinder-851279-4-iscsi devstack@n-api.service[103802]: detected number of CPU cores: 4 Aug 03 05:03:52.165861 dv-cinder-851279-4-iscsi devstack@n-api.service[103802]: current working directory: / Aug 03 05:03:52.165861 dv-cinder-851279-4-iscsi devstack@n-api.service[103802]: detected binary path: /usr/bin/uwsgi-core Aug 03 05:03:52.165861 dv-cinder-851279-4-iscsi devstack@n-api.service[103802]: your processes number limit is 47680 Aug 03 05:03:52.165861 dv-cinder-851279-4-iscsi devstack@n-api.service[103802]: your memory page size is 4096 bytes Aug 03 05:03:52.165861 dv-cinder-851279-4-iscsi devstack@n-api.service[103802]: detected max file descriptor number: 2048 Aug 03 05:03:52.165861 dv-cinder-851279-4-iscsi devstack@n-api.service[103802]: lock engine: pthread robust mutexes Aug 03 05:03:52.165861 dv-cinder-851279-4-iscsi devstack@n-api.service[103802]: thunder lock: enabled Aug 03 05:03:52.165861 dv-cinder-851279-4-iscsi devstack@n-api.service[103802]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 03 05:03:52.165861 dv-cinder-851279-4-iscsi devstack@n-api.service[103802]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 03 05:03:52.203141 dv-cinder-851279-4-iscsi devstack@n-api.service[103802]: Python main interpreter initialized at 0x55cb55e0a9c0 Aug 03 05:03:52.203141 dv-cinder-851279-4-iscsi devstack@n-api.service[103802]: python threads support enabled Aug 03 05:03:52.203141 dv-cinder-851279-4-iscsi devstack@n-api.service[103802]: your server socket listen backlog is limited to 100 connections Aug 03 05:03:52.203141 dv-cinder-851279-4-iscsi devstack@n-api.service[103802]: your mercy for graceful operations on workers is 90 seconds Aug 03 05:03:52.203496 dv-cinder-851279-4-iscsi devstack@n-api.service[103802]: mapped 403077 bytes (393 KB) for 2 cores Aug 03 05:03:52.203592 dv-cinder-851279-4-iscsi devstack@n-api.service[103802]: *** Operational MODE: preforking *** Aug 03 05:03:52.203833 dv-cinder-851279-4-iscsi devstack@n-api.service[103802]: *** uWSGI is running in multiple interpreter mode *** Aug 03 05:03:52.203833 dv-cinder-851279-4-iscsi devstack@n-api.service[103802]: spawned uWSGI master process (pid: 103802) Aug 03 05:03:52.204043 dv-cinder-851279-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 03 05:03:52.204960 dv-cinder-851279-4-iscsi devstack@n-api.service[103802]: spawned uWSGI worker 1 (pid: 103803, cores: 1) Aug 03 05:03:52.205060 dv-cinder-851279-4-iscsi devstack@n-api.service[103802]: spawned uWSGI worker 2 (pid: 103804, cores: 1) Aug 03 05:03:52.205136 dv-cinder-851279-4-iscsi devstack@n-api.service[103802]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 03 05:03:52.868794 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 03 05:03:52.872259 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 03 05:03:53.950812 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 05:03:53.950812 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: from cryptography.utils import int_from_bytes Aug 03 05:03:53.951441 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 05:03:53.951441 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: from cryptography.utils import int_from_bytes Aug 03 05:03:53.953499 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 05:03:53.953499 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: from cryptography.utils import int_from_bytes Aug 03 05:03:53.953942 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 05:03:53.953942 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: from cryptography.utils import int_from_bytes Aug 03 05:03:56.424559 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 03 05:03:56.425186 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 03 05:03:56.425330 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 03 05:03:56.425692 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 03 05:03:56.425947 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 03 05:03:56.426334 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.426422 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 03 05:03:56.426787 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 03 05:03:56.426890 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.426999 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.427161 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 03 05:03:56.427318 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.427520 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 03 05:03:56.427648 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.427775 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 03 05:03:56.427958 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.428165 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.428266 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.428498 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.428583 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.428823 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.428909 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.429139 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.429230 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.429455 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.429552 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.429762 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.429846 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851279-4-iscsi {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.430081 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.430165 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.430387 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.430480 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.430696 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.430786 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.430984 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.431072 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.431300 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.431394 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.431624 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851279-4-iscsi {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.431719 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.431930 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.432044 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.432237 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.432438 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.432559 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.432855 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.432991 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.433725 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.433867 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.434040 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.434233 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.434351 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.434474 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.434678 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.434834 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.435015 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.435172 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.435335 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.435461 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.435661 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.435821 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.435965 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.436087 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.436262 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.436403 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.436659 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851279-4-iscsi {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.436786 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.436976 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.437120 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.437281 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.437421 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.437596 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.437727 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.437901 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.438036 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.438297 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851279-4-iscsi {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.438456 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.438606 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.438743 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.438950 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.439087 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.439273 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.439409 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.439580 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.439734 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.439898 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.440052 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.440224 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.440407 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.440555 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.440720 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.440874 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.441019 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.441166 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.441313 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.441454 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.441590 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.441724 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.441863 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.442031 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.442172 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.442309 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.442469 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.442613 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.442762 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.442936 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.443082 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.443228 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.443367 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.443502 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.443676 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.443830 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.443966 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.444119 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.444260 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.444395 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.444546 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.444691 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.444828 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.444980 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.445115 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.445257 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.445401 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.445536 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.445710 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.445865 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.446010 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.446155 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.446289 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.446432 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.446588 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.446725 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.446895 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.447060 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.447196 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.447346 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.447487 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.447629 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.447770 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.447905 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.448045 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.448181 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.448313 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.448464 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.448620 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.448755 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.448917 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.449068 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.449214 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.449412 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.449567 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.449712 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.449846 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.449981 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.450122 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.450266 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.450410 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.450582 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.450724 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.450916 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.451138 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.451338 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.451429 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.451548 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.451688 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.451862 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.452025 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.452179 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.452325 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.452467 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.452637 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.452781 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.452957 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.453120 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.453265 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.453407 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.453571 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.453719 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.453856 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.453997 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.454140 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.454287 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.454457 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.454601 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.454766 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.454940 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.455101 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.455258 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.455394 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.455534 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.455681 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.455879 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.456020 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.456154 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.456306 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.456446 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.456590 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.456725 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.456859 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.456992 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.457125 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.457258 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.457428 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.457580 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.457715 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.457848 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.458020 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.458174 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.458317 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.458453 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.458622 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.458774 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.458951 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.459097 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.459241 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.459382 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.459548 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.459694 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.459851 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.460011 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.460155 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.460298 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.460450 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.460585 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.460741 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.460892 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.461029 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.461163 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.461348 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.461490 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.461651 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.461802 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.461960 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.462102 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.462243 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.462392 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.462527 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.462670 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.462813 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.462983 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.463132 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.463268 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.463429 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.463585 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.463722 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.463871 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.464030 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.464179 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.464358 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.464513 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.464649 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.464790 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.464934 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.465068 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.465234 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.465390 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.465536 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.465670 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.465815 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.465949 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.466091 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.466226 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.466389 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.466533 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.466688 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.466858 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.467014 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.467159 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.467339 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.467480 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.467628 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.467770 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.467918 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.468063 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.468225 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.468368 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.468540 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.468690 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.468833 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.468969 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.469159 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.469309 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.469453 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.469615 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.469752 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.469896 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.470034 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.470168 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.470349 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:03:56.470505 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.470680 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.470824 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.471038 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.471190 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.471345 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.471541 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.471698 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.471834 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.471967 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.472102 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.472245 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.472380 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.472547 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.472689 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.472863 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.473006 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.473178 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.473320 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.473503 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.473646 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.473813 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.473954 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.474125 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.474357 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.474508 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.474646 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.474786 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.475031 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.475181 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.475317 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.475459 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.475605 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.475741 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.475874 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.476021 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.476157 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.476293 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.476427 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.476622 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.476766 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.476911 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.477048 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.477182 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.477328 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.477497 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.477649 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.477808 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.477951 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.478128 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.478269 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.478441 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.478599 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.478763 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.478928 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.479120 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.479261 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.479434 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.479596 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.479740 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.480380 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.480563 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.480707 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.480877 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.481031 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.481192 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.481335 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.481505 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.481647 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.481817 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.481971 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.482133 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.482282 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.482449 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.482592 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.482761 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.482924 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.483095 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.483238 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.483411 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.483555 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.483722 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.483865 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.484035 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.484190 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.484349 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.484492 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.484637 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.484772 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.484944 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.485094 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.485251 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.485395 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.485561 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.485711 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.485854 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.485997 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.486166 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.486324 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.486460 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.486594 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.486768 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.486976 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.487113 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.487258 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.487421 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.487572 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.487739 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.487900 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.488059 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.488215 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.488359 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.488495 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.488629 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.488771 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.488931 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.489083 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.489229 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.489375 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.489518 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.489654 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.489837 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.489989 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.490147 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.490290 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.490453 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.490595 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.490772 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.490942 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.491104 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.491245 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.491407 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.491549 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.491699 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.491844 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.492015 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.492158 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.492317 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.492458 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.492624 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.492776 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.492920 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.493095 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.493237 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.493387 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.493524 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.493678 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.493815 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.493956 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.494093 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.494235 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.494403 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.494555 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.494697 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.494834 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.495047 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.495202 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.495363 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.495505 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.496243 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.496346 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.496553 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.496662 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.496864 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.496954 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.497171 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.497270 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.497472 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.497568 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.497781 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.497871 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.498091 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.498180 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.498390 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.498492 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.498692 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.498795 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.499278 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.499372 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.499581 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.499679 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.499883 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.499969 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.500190 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.500304 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.500493 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.500581 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.500792 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.500889 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.501094 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.501283 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.501390 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.501471 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.501687 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.501785 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.502006 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.502103 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.502315 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.502404 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.502617 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.502707 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.502944 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.503049 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.503249 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.503344 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.503593 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.503681 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.503898 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.503994 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.504206 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.504300 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.504521 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.504616 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.504832 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.504919 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.505143 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.505230 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.505463 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.505559 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.505774 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.505870 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.506085 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.506173 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.506393 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.506486 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.506701 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.506788 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.507037 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.507138 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.507358 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.507452 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.507668 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.507756 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.507983 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.508069 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.508291 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.508378 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.508618 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.508798 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.508973 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.509125 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.509269 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.509432 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.509586 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.509730 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.509872 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.510013 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.510161 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.510311 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.510463 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.510612 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.510754 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.510921 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.511069 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.511250 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.511420 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.511567 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.511710 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.511852 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.511993 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.512143 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.512284 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.512442 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.512584 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.512733 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.512884 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.513035 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.513201 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.513347 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.513496 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.513644 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.513803 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.513948 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.514089 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.514240 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.514382 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.514524 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.514679 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.514829 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.515049 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.515192 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.515340 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.515489 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.515639 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.515788 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.515929 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.516070 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.516241 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.516478 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.516642 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.516786 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.516927 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.517101 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.517286 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.517443 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.517594 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.517735 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.517876 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.518025 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.518167 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.518390 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.518548 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.518692 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.518833 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.518999 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.519141 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.519295 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.519445 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.519590 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.519731 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.519872 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.520086 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.520243 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.520396 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.520549 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.520691 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.520837 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.520988 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.521130 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.521272 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.521418 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.521559 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.521701 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.521859 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.522002 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.522142 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.522297 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.522448 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.522596 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.522745 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.522905 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.523053 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.523194 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.523343 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.523486 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.523634 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.523776 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.523916 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.524072 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.524214 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.524367 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.524510 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.524657 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.524798 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.524945 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.525086 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.525235 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.525377 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.525524 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.525684 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.525827 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.525977 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.526127 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.526277 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.526418 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.526565 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.526705 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.527343 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.527436 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.527524 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.527603 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.527681 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.527759 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.527987 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.528075 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.528303 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.528398 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.528624 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.528711 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.528929 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.529015 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.529237 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.529329 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.529548 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.529634 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.529852 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.529940 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.530158 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.530245 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.530473 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.530565 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.530777 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.531066 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.531154 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.531402 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.531499 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.531703 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.531797 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.532015 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.532100 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.532331 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.532416 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.532643 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.532893 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.532979 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.533227 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.533313 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.533547 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.533645 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.533867 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.533964 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.534181 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.534266 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.534487 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.534572 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.534792 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.534899 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.535128 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.535214 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.535432 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.535517 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.535737 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.535836 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.536040 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.536138 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.536346 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.536430 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.536645 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.536738 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.536948 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.537042 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.537249 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.537346 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.537548 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.537641 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.537848 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.537933 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.538152 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.538238 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.538453 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.538540 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.538752 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.538853 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.539077 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.539164 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.539389 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.539476 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.539687 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.539772 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.539989 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.540075 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.540290 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.540398 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.540631 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.540733 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.540935 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.541032 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.541270 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.541358 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.541570 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.541655 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.541878 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.541972 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.542180 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.542309 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.543065 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.543207 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.543385 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.543532 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.543690 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.543818 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.543995 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.544130 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.544297 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.544438 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.544606 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.544743 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.544914 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.545040 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.545216 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.545344 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.545527 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.545655 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.545829 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.545955 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.546132 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.546260 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.546436 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.546570 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.546739 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.546886 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.547070 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.547199 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.547372 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.547499 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.547680 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.547805 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.547986 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.548112 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.548290 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.548415 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.548589 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.548724 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.548893 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.549025 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.549196 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.549329 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.549493 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.549633 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.549804 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.549937 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.550102 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.550228 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.550406 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.550542 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.550704 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.550829 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.551032 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.551238 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.551375 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.551507 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.551632 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.551756 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.551911 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.552038 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.552209 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.552334 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.552517 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.552650 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.552818 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.552945 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.553116 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.553242 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.553418 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.553545 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.553721 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.553841 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.554042 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.554167 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.554290 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.554413 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.554596 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.554723 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.554935 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.555063 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.555241 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.555367 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.555541 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.555666 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.555841 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.555968 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.556140 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.556265 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.556443 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.556583 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.556745 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.556872 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.557051 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.557177 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.557351 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.557486 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.557649 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.557782 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.557952 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.558589 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.558781 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.558963 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.559092 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.559222 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.559386 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.559513 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.559690 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.559824 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.559991 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.560119 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.560293 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.560419 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.560591 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.560723 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.560889 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.561014 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.561210 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.561337 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.561516 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.561644 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.561819 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.561945 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.562123 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.562251 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.562423 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.562551 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.562747 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.562903 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.563081 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.563207 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.563391 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.563517 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.563694 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.563821 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.564008 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.564144 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.564319 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.564446 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.564625 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.564756 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.564927 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.565064 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.565241 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.565370 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.565522 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.565641 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.565833 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.565969 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.566139 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.566264 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.566449 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.566575 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.566753 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.566917 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.567082 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.567209 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.567403 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.567531 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.567713 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.567846 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.568026 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.568183 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.568316 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.568440 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.568630 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.568764 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.568941 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.569068 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.569244 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.569369 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.569551 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.569670 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.569856 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.569982 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.570164 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.570290 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.570471 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.570599 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.570774 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.570956 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.571111 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.571247 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.571420 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.571545 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.571724 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.571851 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.572033 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.572160 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.572342 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.572462 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.572643 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.572777 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.572946 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.573085 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.573249 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.573375 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.573551 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.574275 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.574430 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.574566 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.574747 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.574892 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.575080 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.575208 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.575389 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.575524 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.575693 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.575828 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.576006 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.576132 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.576310 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.576438 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.576655 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.576781 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.576968 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.577095 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.577272 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.577400 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.577621 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.577747 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.577933 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.578060 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.578245 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.578385 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.578561 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.578687 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.578899 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.579042 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.579207 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.579339 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.579521 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.579658 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.579844 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.579980 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.580150 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.580277 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.580453 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.580580 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.580758 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.580897 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.581080 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.581207 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.581385 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.581512 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.581704 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.581841 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.582008 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.582143 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.582311 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.582437 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.582613 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.582741 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.582959 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.583132 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.583261 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.583447 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.583649 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.583776 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.583966 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.584093 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.584274 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.584400 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.584578 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.584712 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.584973 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.585104 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.585286 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.585423 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.585591 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.585717 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.585911 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.586061 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.586230 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.586358 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.586539 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.586665 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.586858 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.587002 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.587173 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.587306 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.587479 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.587605 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.587803 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.587932 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.588113 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.588245 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.588423 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.588558 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.588735 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.588862 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.589041 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.589167 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.589617 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.589763 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.589879 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.590110 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.590416 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.590911 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.591235 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.592498 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.592498 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.592498 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.592863 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.592994 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.593314 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.593788 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.594131 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.595363 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.595363 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.595363 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.595753 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.595919 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.599974 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.600096 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.600190 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.600266 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.600345 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.600416 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.600484 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.600560 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.600629 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.600704 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.600853 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.600938 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.601009 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.601083 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.601151 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.601227 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.601296 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.601371 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.601439 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.601513 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.601581 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.601656 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.601732 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.601800 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.601867 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.601934 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.602000 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.602075 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.602144 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.602211 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.602285 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.602378 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.602453 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.602538 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.602608 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.602699 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.602779 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.602879 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.602967 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.603038 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.603114 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.603206 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.603274 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.603274 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.603413 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.603413 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.603624 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.603752 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.603849 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.604186 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.604331 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.604511 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.604781 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.604887 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.605180 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.605277 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.605491 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.605581 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.605799 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.605895 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.606113 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.606211 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.606420 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.606516 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.606727 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.606816 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.607066 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.607169 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.607380 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.607472 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.607686 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.607781 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.607987 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.608084 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.608294 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.608383 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.608603 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.608692 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.608906 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.609008 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.609212 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.609300 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.609519 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.609607 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.609823 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.609919 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.610124 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.610212 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.610427 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.610514 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.610740 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.610829 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.611090 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.611190 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.611399 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.611488 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.611706 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.611796 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.612012 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.612102 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.612316 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.612412 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.612659 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.612748 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.612963 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.613051 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.613286 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.613386 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.613607 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.613778 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.613918 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.614058 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.614222 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.614364 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.614540 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.614674 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.614871 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.615007 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.615191 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.615336 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.615506 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.615637 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.615821 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.615951 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.616137 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.616281 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.616451 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.616575 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.616768 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.616997 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.617138 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.617317 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.617450 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.617632 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.617773 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.617950 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.618091 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.618267 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.618409 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.618584 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.618810 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.618955 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.619165 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.619305 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.619480 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.619620 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.619797 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.619929 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.620129 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.620273 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.620428 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.621058 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.621280 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.621426 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.621592 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.621723 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.621906 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.622037 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.622217 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.622358 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.622533 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.622743 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.622896 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.623043 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.623170 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.623311 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.623512 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.623642 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.623826 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.624226 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.624405 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.624535 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.624690 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.624823 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.625006 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.625138 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.625320 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.625457 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.625634 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.625764 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.625947 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.626089 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.626262 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.626393 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.626570 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.626700 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.626901 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.627048 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.627216 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.627353 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.627529 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.627660 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.627866 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.627996 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.628138 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.628279 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.628453 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.628591 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.628765 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.628897 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.629074 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.629206 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.629387 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.629524 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.629698 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.629828 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.630025 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.630212 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.630364 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.630530 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.630669 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.630883 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.631017 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.631213 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.631344 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.631538 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.631680 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.631856 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.632126 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.632263 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.632450 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.632591 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.632782 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.632911 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.633088 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.633219 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.633398 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.633543 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.633706 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.633838 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.634010 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.634140 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.634329 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.634460 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.634635 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.634764 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.634964 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.635106 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.635276 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.635407 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.635580 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.635709 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.635882 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.636127 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.636806 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.637000 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.637139 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.637324 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.637454 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.637647 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.637787 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.637961 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.638099 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.638684 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.638816 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.639037 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.639150 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.639258 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.639365 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.639479 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.639588 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.639703 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.639820 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.639928 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.640096 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.640213 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.640418 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.640562 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.640731 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.640852 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.641005 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.641123 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.643468 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.643657 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.643799 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.643933 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.644066 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.644196 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.644335 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.644465 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.644593 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.644721 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.644849 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.644976 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.645104 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.645233 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.645367 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.645495 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.645630 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.645765 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.645902 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.646031 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.646159 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.646293 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.646421 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.646548 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.646685 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.646813 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.646958 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.647086 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.647213 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.647352 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.647482 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.647610 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.647737 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.647846 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.647973 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.648108 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.648238 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.648365 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.648491 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.648617 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.648751 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.648892 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.649027 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.649155 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.649291 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.649418 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.649545 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.649681 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.649808 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.649934 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.650068 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.650195 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.650331 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.650489 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.650619 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.650745 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.650917 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.651059 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.651246 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.651378 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.651505 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.651640 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.651640 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.651898 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.652036 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.652164 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.652291 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.652427 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.652556 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.652689 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.652829 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.652957 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.653074 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.653198 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.653198 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.653446 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.653574 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.653711 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.653914 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.654112 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.654306 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.654506 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.654707 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.654936 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.655148 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.655355 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.655566 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.655795 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.656006 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.656227 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.656433 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.656638 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.656837 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.657054 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.657267 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.657492 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.657706 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.657916 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.658141 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.658350 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.658554 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.658745 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.659580 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.659884 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.660096 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.660212 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.660396 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.660517 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.660627 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.660753 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.660868 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.660976 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.661082 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.661189 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.661470 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.661627 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.661738 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.661846 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.662036 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.662152 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.662281 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.662399 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.662509 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.662616 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.662723 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.662831 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.662966 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.663089 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.663207 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.663315 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.663422 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.663531 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.663647 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.663756 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.663864 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.663972 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.663972 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.664172 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.664294 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.664402 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.664509 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.664616 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.664723 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.664839 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.664957 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.665065 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.665172 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.665279 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.665386 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.665505 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.665614 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.665740 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.665850 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.665957 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.666072 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.666194 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.666302 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.666409 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.666516 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.666623 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.666730 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.666897 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.667586 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.667719 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.667849 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.667991 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.668122 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.668251 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.668379 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.668507 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.668641 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.668788 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.668788 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.669033 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.669170 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.669298 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.669426 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.669563 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.669693 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.669820 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.669948 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.670088 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.670218 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.670354 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.670483 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.670610 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.670746 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.670895 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.671039 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.671170 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.671298 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.671433 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.671562 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.671689 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.671825 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.671963 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.672098 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.672227 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.672357 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.672485 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.672626 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.672755 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.672883 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.673011 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.673147 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.673276 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.673413 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.673530 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.673657 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.673785 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.673912 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.674048 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.674177 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.674304 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.674433 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.674604 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.674741 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.674897 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.674897 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.675141 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.675276 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.675405 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.675532 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.675669 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.675798 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.675933 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.676068 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.676197 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.676324 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.676460 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.676596 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.676732 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.676860 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.676994 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.677120 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.677247 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.677375 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.677491 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.677617 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.677743 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.677879 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.678007 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.678133 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.678267 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.678395 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.678521 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.678659 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.678787 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.678965 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.679094 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.679234 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.679372 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.679501 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.679637 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.679765 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.679900 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.680079 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.680220 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.680390 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.680522 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.680700 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.680832 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.681009 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.681150 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.681337 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.681475 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.681666 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.681797 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.681976 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.682123 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.682298 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.682427 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.682610 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.682749 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.682951 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.683586 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.683786 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.683917 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.684097 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.684226 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.684410 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.684534 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.684723 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.684864 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.685031 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.685175 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.685379 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.685592 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.685711 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.685820 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.685929 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.686046 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.686239 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.686356 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.686554 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.686671 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.686884 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.687025 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.687208 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.687326 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.687525 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.687643 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.687850 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.687980 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.688172 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.688295 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.688481 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.688605 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.688807 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.688932 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.689226 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.689389 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.689501 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.689609 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.689725 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 03 05:03:56.689843 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.690092 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.690426 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.690733 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.691109 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.691400 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:03:56.691619 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 03 05:03:56.843767 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: INFO dbcounter [None req-92aa45b3-e5c5-48a7-861b-2c6d0e594c45 None None] Registered counter for database nova_api Aug 03 05:03:56.845359 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: INFO dbcounter [None req-b86c828d-4440-4b54-8eb5-062b498189f1 None None] Registered counter for database nova_api Aug 03 05:03:56.865096 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG oslo_db.sqlalchemy.engines [None req-92aa45b3-e5c5-48a7-861b-2c6d0e594c45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103803) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 05:03:56.867839 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG oslo_db.sqlalchemy.engines [None req-b86c828d-4440-4b54-8eb5-062b498189f1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103804) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 05:03:56.872445 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG dbcounter [-] [103803] Writer thread running {{(pid=103803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 05:03:56.875173 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG dbcounter [-] [103804] Writer thread running {{(pid=103804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 05:03:56.927950 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.context [None req-92aa45b3-e5c5-48a7-861b-2c6d0e594c45 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e4c70b33-dcef-4553-8910-fe7fe241a76c(cell1) {{(pid=103803) load_cells /opt/stack/nova/nova/context.py:464}} Aug 03 05:03:56.930398 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.context [None req-b86c828d-4440-4b54-8eb5-062b498189f1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e4c70b33-dcef-4553-8910-fe7fe241a76c(cell1) {{(pid=103804) load_cells /opt/stack/nova/nova/context.py:464}} Aug 03 05:03:56.931807 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG oslo_concurrency.lockutils [None req-92aa45b3-e5c5-48a7-861b-2c6d0e594c45 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103803) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:56.933992 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG oslo_concurrency.lockutils [None req-92aa45b3-e5c5-48a7-861b-2c6d0e594c45 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103803) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:56.934788 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG oslo_concurrency.lockutils [None req-92aa45b3-e5c5-48a7-861b-2c6d0e594c45 None None] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103803) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:56.934959 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG oslo_concurrency.lockutils [None req-b86c828d-4440-4b54-8eb5-062b498189f1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:56.936534 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG oslo_concurrency.lockutils [None req-b86c828d-4440-4b54-8eb5-062b498189f1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:56.936781 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG oslo_concurrency.lockutils [None req-92aa45b3-e5c5-48a7-861b-2c6d0e594c45 None None] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103803) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:56.937337 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG oslo_concurrency.lockutils [None req-b86c828d-4440-4b54-8eb5-062b498189f1 None None] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:56.938744 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: INFO dbcounter [None req-92aa45b3-e5c5-48a7-861b-2c6d0e594c45 None None] Registered counter for database nova_cell0 Aug 03 05:03:56.939350 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG oslo_concurrency.lockutils [None req-b86c828d-4440-4b54-8eb5-062b498189f1 None None] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:56.941358 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: INFO dbcounter [None req-b86c828d-4440-4b54-8eb5-062b498189f1 None None] Registered counter for database nova_cell0 Aug 03 05:03:56.944239 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: INFO dbcounter [None req-92aa45b3-e5c5-48a7-861b-2c6d0e594c45 None None] Registered counter for database nova_cell1 Aug 03 05:03:56.946968 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: INFO dbcounter [None req-b86c828d-4440-4b54-8eb5-062b498189f1 None None] Registered counter for database nova_cell1 Aug 03 05:03:56.952255 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG oslo_db.sqlalchemy.engines [None req-92aa45b3-e5c5-48a7-861b-2c6d0e594c45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103803) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 05:03:56.953057 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG oslo_db.sqlalchemy.engines [None req-92aa45b3-e5c5-48a7-861b-2c6d0e594c45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103803) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 05:03:56.954868 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG oslo_db.sqlalchemy.engines [None req-b86c828d-4440-4b54-8eb5-062b498189f1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103804) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 05:03:56.958030 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG oslo_db.sqlalchemy.engines [None req-b86c828d-4440-4b54-8eb5-062b498189f1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103804) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 05:03:56.961241 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG dbcounter [-] [103803] Writer thread running {{(pid=103803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 05:03:56.961581 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG dbcounter [-] [103803] Writer thread running {{(pid=103803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 05:03:56.962435 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG dbcounter [-] [103804] Writer thread running {{(pid=103804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 05:03:57.098575 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG dbcounter [-] [103804] Writer thread running {{(pid=103804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 05:03:57.105499 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: INFO dbcounter [None req-92aa45b3-e5c5-48a7-861b-2c6d0e594c45 None None] Registered counter for database nova_cell0 Aug 03 05:03:57.108474 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: INFO dbcounter [None req-b86c828d-4440-4b54-8eb5-062b498189f1 None None] Registered counter for database nova_cell0 Aug 03 05:03:57.114759 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG oslo_db.sqlalchemy.engines [None req-92aa45b3-e5c5-48a7-861b-2c6d0e594c45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103803) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 05:03:57.118388 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG oslo_db.sqlalchemy.engines [None req-b86c828d-4440-4b54-8eb5-062b498189f1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103804) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 05:03:57.119248 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG dbcounter [-] [103803] Writer thread running {{(pid=103803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 05:03:57.123060 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG dbcounter [-] [103804] Writer thread running {{(pid=103804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 05:03:57.536223 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: WARNING keystonemiddleware.auth_token [None req-92aa45b3-e5c5-48a7-861b-2c6d0e594c45 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 05:03:57.543615 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: WARNING keystonemiddleware.auth_token [None req-92aa45b3-e5c5-48a7-861b-2c6d0e594c45 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 05:03:57.561924 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: WARNING keystonemiddleware.auth_token [None req-b86c828d-4440-4b54-8eb5-062b498189f1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 05:03:57.569150 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: WARNING keystonemiddleware.auth_token [None req-b86c828d-4440-4b54-8eb5-062b498189f1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 05:03:57.891922 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: WARNING keystonemiddleware.auth_token [None req-92aa45b3-e5c5-48a7-861b-2c6d0e594c45 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 05:03:57.898156 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: WARNING keystonemiddleware.auth_token [None req-92aa45b3-e5c5-48a7-861b-2c6d0e594c45 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 05:03:57.903627 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55cb55e0a9c0 pid: 103803 (default app) Aug 03 05:03:57.905692 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi [None req-92aa45b3-e5c5-48a7-861b-2c6d0e594c45 None None] Calling method '>' {{(pid=103803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:03:57.906899 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: INFO nova.api.openstack.requestlog [None req-92aa45b3-e5c5-48a7-861b-2c6d0e594c45 None None] 10.222.0.40 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001732 Aug 03 05:03:57.907320 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: [pid: 103803|app: 0|req: 1/1] 10.222.0.40 () {50 vars in 788 bytes} [Wed Aug 3 05:03:57 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:03:57.916462 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: WARNING keystonemiddleware.auth_token [None req-b86c828d-4440-4b54-8eb5-062b498189f1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 05:03:57.923006 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: WARNING keystonemiddleware.auth_token [None req-b86c828d-4440-4b54-8eb5-062b498189f1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 05:03:57.928349 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55cb55e0a9c0 pid: 103804 (default app) Aug 03 05:05:16.931909 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi [None req-92aa45b3-e5c5-48a7-861b-2c6d0e594c45 None None] Calling method '>' {{(pid=103803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:05:16.936785 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: INFO nova.api.openstack.requestlog [None req-92aa45b3-e5c5-48a7-861b-2c6d0e594c45 None None] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Aug 03 05:05:16.936785 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: [pid: 103803|app: 0|req: 2/2] 10.222.0.40 () {54 vars in 930 bytes} [Wed Aug 3 05:05:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:05:16.945140 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG dbcounter [-] [103804] Writing DB stats nova_api:SELECT=3 {{(pid=103804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:05:16.946261 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG dbcounter [-] [103804] Writing DB stats nova_cell1:SELECT=3 {{(pid=103804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:05:16.947072 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG dbcounter [-] [103804] Writing DB stats nova_cell0:SELECT=3 {{(pid=103804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:05:16.948106 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG dbcounter [-] [103804] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:05:17.828716 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi [None req-d8987973-6fcb-4e71-83c6-248aa3687fb7 admin admin] Calling method '>' {{(pid=103804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:05:17.865989 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: INFO nova.api.openstack.requestlog [None req-d8987973-6fcb-4e71-83c6-248aa3687fb7 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.925883 Aug 03 05:05:17.867475 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: [pid: 103804|app: 0|req: 1/3] 10.222.0.40 () {60 vars in 1291 bytes} [Wed Aug 3 05:05:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:05:20.084987 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi [None req-92aa45b3-e5c5-48a7-861b-2c6d0e594c45 None None] Calling method '>' {{(pid=103803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:05:20.086197 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: INFO nova.api.openstack.requestlog [None req-92aa45b3-e5c5-48a7-861b-2c6d0e594c45 None None] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001682 Aug 03 05:05:20.087664 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: [pid: 103803|app: 0|req: 3/4] 10.222.0.40 () {54 vars in 930 bytes} [Wed Aug 3 05:05:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:05:20.551562 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi [None req-d84f84aa-ff6b-4bff-ba20-c18e5d41aab5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 1, "swap": 0, "ram": 256, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "c1", "name": "cirros256"}} {{(pid=103804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:05:20.572588 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 05:05:20.572588 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: warnings.warn(msg) Aug 03 05:05:20.655357 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: INFO nova.api.openstack.requestlog [None req-d84f84aa-ff6b-4bff-ba20-c18e5d41aab5 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.559989 Aug 03 05:05:20.655934 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: [pid: 103804|app: 0|req: 2/5] 10.222.0.40 () {64 vars in 1282 bytes} [Wed Aug 3 05:05:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 05:05:20.671233 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG dbcounter [-] [103803] Writing DB stats nova_api:SELECT=3 {{(pid=103803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:05:20.672428 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG dbcounter [-] [103803] Writing DB stats nova_cell1:SELECT=3 {{(pid=103803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:05:20.673476 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG dbcounter [-] [103803] Writing DB stats nova_cell0:SELECT=3 {{(pid=103803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:05:20.674251 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG dbcounter [-] [103803] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:05:20.883970 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi [None req-f134187b-57d9-4edc-a64e-21fd367bda7b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:05:20.888311 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 05:05:20.888311 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: warnings.warn(msg) Aug 03 05:05:21.004142 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: INFO nova.api.openstack.requestlog [None req-f134187b-57d9-4edc-a64e-21fd367bda7b admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.338330 Aug 03 05:05:21.004971 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: [pid: 103803|app: 0|req: 4/6] 10.222.0.40 () {64 vars in 1335 bytes} [Wed Aug 3 05:05:20 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:05:23.255354 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi [None req-d84f84aa-ff6b-4bff-ba20-c18e5d41aab5 admin admin] Calling method '>' {{(pid=103804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:05:23.256417 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: INFO nova.api.openstack.requestlog [None req-d84f84aa-ff6b-4bff-ba20-c18e5d41aab5 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001575 Aug 03 05:05:23.257516 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: [pid: 103804|app: 0|req: 3/7] 10.222.0.40 () {54 vars in 930 bytes} [Wed Aug 3 05:05:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:05:23.966998 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi [None req-12f1f24d-06f8-4d6e-8e51-08f528731039 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d1", "name": "ds512M", "vcpus": 1, "disk": 5}} {{(pid=103803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:05:23.987050 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 05:05:23.987050 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: warnings.warn(msg) Aug 03 05:05:24.079455 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: INFO nova.api.openstack.requestlog [None req-12f1f24d-06f8-4d6e-8e51-08f528731039 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.815434 Aug 03 05:05:24.080416 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: [pid: 103803|app: 0|req: 5/8] 10.222.0.40 () {64 vars in 1282 bytes} [Wed Aug 3 05:05:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 05:05:24.092905 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi [None req-df74b39a-c379-42a8-b1ef-a6948561fbe9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:05:24.097156 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 05:05:24.097156 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: warnings.warn(msg) Aug 03 05:05:24.190209 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: INFO nova.api.openstack.requestlog [None req-df74b39a-c379-42a8-b1ef-a6948561fbe9 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.100900 Aug 03 05:05:24.191033 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: [pid: 103804|app: 0|req: 4/9] 10.222.0.40 () {64 vars in 1335 bytes} [Wed Aug 3 05:05:24 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:05:26.485522 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi [None req-12f1f24d-06f8-4d6e-8e51-08f528731039 admin admin] Calling method '>' {{(pid=103803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:05:26.486488 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: INFO nova.api.openstack.requestlog [None req-12f1f24d-06f8-4d6e-8e51-08f528731039 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Aug 03 05:05:26.486952 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: [pid: 103803|app: 0|req: 6/10] 10.222.0.40 () {54 vars in 930 bytes} [Wed Aug 3 05:05:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:05:26.887847 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi [None req-4f3d4ecd-bcfa-49b5-9492-875d357304c9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "ds1G", "ram": 1024, "swap": 0, "disk": 10}} {{(pid=103804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:05:26.964058 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: INFO nova.api.openstack.requestlog [None req-4f3d4ecd-bcfa-49b5-9492-875d357304c9 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.471309 Aug 03 05:05:26.964634 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: [pid: 103804|app: 0|req: 5/11] 10.222.0.40 () {64 vars in 1282 bytes} [Wed Aug 3 05:05:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 05:05:26.976620 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi [None req-97f4a598-28f7-4c64-a57d-4ea4d5627fed admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:05:27.058719 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: INFO nova.api.openstack.requestlog [None req-97f4a598-28f7-4c64-a57d-4ea4d5627fed admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085809 Aug 03 05:05:27.059358 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: [pid: 103803|app: 0|req: 7/12] 10.222.0.40 () {64 vars in 1335 bytes} [Wed Aug 3 05:05:26 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:05:29.285564 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi [None req-4f3d4ecd-bcfa-49b5-9492-875d357304c9 admin admin] Calling method '>' {{(pid=103804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:05:29.286572 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: INFO nova.api.openstack.requestlog [None req-4f3d4ecd-bcfa-49b5-9492-875d357304c9 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Aug 03 05:05:29.287001 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: [pid: 103804|app: 0|req: 6/13] 10.222.0.40 () {54 vars in 930 bytes} [Wed Aug 3 05:05:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:05:29.768386 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi [None req-a13a59a5-8377-45cd-9b1a-d995e3ee124a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "rxtx_factor": 1.0, "ram": 2048, "swap": 0, "os-flavor-access:is_public": true, "id": "d3", "disk": 10, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:05:29.844778 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: INFO nova.api.openstack.requestlog [None req-a13a59a5-8377-45cd-9b1a-d995e3ee124a admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.552025 Aug 03 05:05:29.847108 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: [pid: 103803|app: 0|req: 8/14] 10.222.0.40 () {64 vars in 1282 bytes} [Wed Aug 3 05:05:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 05:05:29.857930 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi [None req-dd5b28b4-7a74-4223-bcd7-47623a00bfb9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:05:29.922480 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: INFO nova.api.openstack.requestlog [None req-dd5b28b4-7a74-4223-bcd7-47623a00bfb9 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.068177 Aug 03 05:05:29.923126 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: [pid: 103804|app: 0|req: 7/15] 10.222.0.40 () {64 vars in 1335 bytes} [Wed Aug 3 05:05:29 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:05:32.155861 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi [None req-a13a59a5-8377-45cd-9b1a-d995e3ee124a admin admin] Calling method '>' {{(pid=103803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:05:32.156410 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: INFO nova.api.openstack.requestlog [None req-a13a59a5-8377-45cd-9b1a-d995e3ee124a admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Aug 03 05:05:32.157129 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: [pid: 103803|app: 0|req: 9/16] 10.222.0.40 () {54 vars in 930 bytes} [Wed Aug 3 05:05:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:05:32.597190 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi [None req-fdb3c76a-875b-4cdf-b6d2-d0358dea94ce admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "ram": 4096, "rxtx_factor": 1.0, "disk": 20, "os-flavor-access:is_public": true, "swap": 0, "id": "d4", "vcpus": 4}} {{(pid=103804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:05:32.673132 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: INFO nova.api.openstack.requestlog [None req-fdb3c76a-875b-4cdf-b6d2-d0358dea94ce admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.510086 Aug 03 05:05:32.673812 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: [pid: 103804|app: 0|req: 8/17] 10.222.0.40 () {64 vars in 1282 bytes} [Wed Aug 3 05:05:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 05:05:32.687150 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi [None req-a392e929-8611-454e-9be2-6dd4820001b3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:05:32.779151 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: INFO nova.api.openstack.requestlog [None req-a392e929-8611-454e-9be2-6dd4820001b3 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096315 Aug 03 05:05:32.779923 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: [pid: 103803|app: 0|req: 10/18] 10.222.0.40 () {64 vars in 1335 bytes} [Wed Aug 3 05:05:32 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:05:35.017430 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi [None req-fdb3c76a-875b-4cdf-b6d2-d0358dea94ce admin admin] Calling method '>' {{(pid=103804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:05:35.018538 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: INFO nova.api.openstack.requestlog [None req-fdb3c76a-875b-4cdf-b6d2-d0358dea94ce admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001590 Aug 03 05:05:35.018999 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: [pid: 103804|app: 0|req: 9/19] 10.222.0.40 () {54 vars in 930 bytes} [Wed Aug 3 05:05:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:05:35.451398 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi [None req-9eae43b4-6330-4143-91f0-b0db764660f2 admin admin] Calling method '>' {{(pid=103803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:05:35.477803 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: INFO nova.api.openstack.requestlog [None req-9eae43b4-6330-4143-91f0-b0db764660f2 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.451348 Aug 03 05:05:35.478353 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: [pid: 103803|app: 0|req: 11/20] 10.222.0.40 () {60 vars in 1291 bytes} [Wed Aug 3 05:05:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:05:38.252201 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi [None req-fdb3c76a-875b-4cdf-b6d2-d0358dea94ce admin admin] Calling method '>' {{(pid=103804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:05:38.253252 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: INFO nova.api.openstack.requestlog [None req-fdb3c76a-875b-4cdf-b6d2-d0358dea94ce admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Aug 03 05:05:38.253671 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: [pid: 103804|app: 0|req: 10/21] 10.222.0.40 () {54 vars in 930 bytes} [Wed Aug 3 05:05:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:05:38.667578 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi [None req-cfaaa1b6-e759-485c-a49a-36328e03418e admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "id": "1", "rxtx_factor": 1.0, "name": "m1.tiny", "disk": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0}} {{(pid=103803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:05:38.811587 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: INFO nova.api.openstack.requestlog [None req-cfaaa1b6-e759-485c-a49a-36328e03418e admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.551650 Aug 03 05:05:38.862986 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: [pid: 103803|app: 0|req: 12/22] 10.222.0.40 () {64 vars in 1282 bytes} [Wed Aug 3 05:05:38 2022] POST /compute/v2.1/flavors => generated 402 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 05:05:38.863144 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi [None req-a89ed55d-6cbb-4371-8198-801987baea75 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:05:38.968916 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: INFO nova.api.openstack.requestlog [None req-a89ed55d-6cbb-4371-8198-801987baea75 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.148285 Aug 03 05:05:38.969481 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: [pid: 103804|app: 0|req: 11/23] 10.222.0.40 () {64 vars in 1332 bytes} [Wed Aug 3 05:05:38 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:05:41.234691 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi [None req-cfaaa1b6-e759-485c-a49a-36328e03418e admin admin] Calling method '>' {{(pid=103803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:05:41.235751 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: INFO nova.api.openstack.requestlog [None req-cfaaa1b6-e759-485c-a49a-36328e03418e admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Aug 03 05:05:41.236305 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: [pid: 103803|app: 0|req: 13/24] 10.222.0.40 () {54 vars in 930 bytes} [Wed Aug 3 05:05:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:05:41.638689 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi [None req-ca519b79-b53f-48d8-ab87-351a8d83ef09 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 20, "name": "m1.small", "id": "2", "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "os-flavor-access:is_public": true}} {{(pid=103804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:05:41.700296 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: INFO nova.api.openstack.requestlog [None req-ca519b79-b53f-48d8-ab87-351a8d83ef09 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.457148 Aug 03 05:05:41.700890 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: [pid: 103804|app: 0|req: 12/25] 10.222.0.40 () {64 vars in 1282 bytes} [Wed Aug 3 05:05:41 2022] POST /compute/v2.1/flavors => generated 405 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 05:05:41.713334 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi [None req-28caab24-4d70-432a-9421-a49f0d9a484c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:05:41.778752 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: INFO nova.api.openstack.requestlog [None req-28caab24-4d70-432a-9421-a49f0d9a484c admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.069541 Aug 03 05:05:41.779561 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: [pid: 103803|app: 0|req: 14/26] 10.222.0.40 () {64 vars in 1332 bytes} [Wed Aug 3 05:05:41 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:05:43.998316 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi [None req-ca519b79-b53f-48d8-ab87-351a8d83ef09 admin admin] Calling method '>' {{(pid=103804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:05:43.999371 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: INFO nova.api.openstack.requestlog [None req-ca519b79-b53f-48d8-ab87-351a8d83ef09 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Aug 03 05:05:43.999779 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: [pid: 103804|app: 0|req: 13/27] 10.222.0.40 () {54 vars in 930 bytes} [Wed Aug 3 05:05:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:05:44.352630 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi [None req-aa63ff53-69bd-4a8d-9904-fbac03daf7c4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "id": "3", "vcpus": 2, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.medium"}} {{(pid=103803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:05:44.563545 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: INFO nova.api.openstack.requestlog [None req-aa63ff53-69bd-4a8d-9904-fbac03daf7c4 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.557873 Aug 03 05:05:44.564108 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: [pid: 103803|app: 0|req: 15/28] 10.222.0.40 () {64 vars in 1282 bytes} [Wed Aug 3 05:05:44 2022] POST /compute/v2.1/flavors => generated 406 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 05:05:44.576159 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi [None req-e4de8c1f-73ac-4924-a4ae-ad0e64de1595 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:05:44.636841 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: INFO nova.api.openstack.requestlog [None req-e4de8c1f-73ac-4924-a4ae-ad0e64de1595 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.064130 Aug 03 05:05:44.658272 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: [pid: 103804|app: 0|req: 14/29] 10.222.0.40 () {64 vars in 1332 bytes} [Wed Aug 3 05:05:44 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:05:46.910480 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi [None req-aa63ff53-69bd-4a8d-9904-fbac03daf7c4 admin admin] Calling method '>' {{(pid=103803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:05:46.911531 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: INFO nova.api.openstack.requestlog [None req-aa63ff53-69bd-4a8d-9904-fbac03daf7c4 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Aug 03 05:05:46.912119 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: [pid: 103803|app: 0|req: 16/30] 10.222.0.40 () {54 vars in 930 bytes} [Wed Aug 3 05:05:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:05:47.391121 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi [None req-b9db1984-4560-4237-8192-14be634e11ba admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.large", "ram": 8192, "id": "4", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "swap": 0, "disk": 80}} {{(pid=103804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:05:47.399077 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG dbcounter [-] [103804] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:05:48.192338 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: INFO nova.api.openstack.requestlog [None req-b9db1984-4560-4237-8192-14be634e11ba admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 1.273419 Aug 03 05:05:48.192910 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: [pid: 103804|app: 0|req: 15/31] 10.222.0.40 () {64 vars in 1282 bytes} [Wed Aug 3 05:05:46 2022] POST /compute/v2.1/flavors => generated 405 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 05:05:48.206688 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi [None req-1c228904-dcc9-46e8-9c88-ee4693bafec8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:05:48.275801 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: INFO nova.api.openstack.requestlog [None req-1c228904-dcc9-46e8-9c88-ee4693bafec8 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.072816 Aug 03 05:05:48.276564 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: [pid: 103803|app: 0|req: 17/32] 10.222.0.40 () {64 vars in 1332 bytes} [Wed Aug 3 05:05:48 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:05:50.509264 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi [None req-b9db1984-4560-4237-8192-14be634e11ba admin admin] Calling method '>' {{(pid=103804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:05:50.510931 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: INFO nova.api.openstack.requestlog [None req-b9db1984-4560-4237-8192-14be634e11ba admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002068 Aug 03 05:05:50.511340 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: [pid: 103804|app: 0|req: 16/33] 10.222.0.40 () {54 vars in 930 bytes} [Wed Aug 3 05:05:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:05:50.989340 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi [None req-9488b852-9c9e-44ea-8a4d-1c10c6253fb9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "name": "m1.xlarge", "os-flavor-access:is_public": true, "disk": 160, "vcpus": 8, "ram": 16384, "rxtx_factor": 1.0}} {{(pid=103803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:05:50.996087 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG dbcounter [-] [103803] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=103803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:05:51.059265 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: INFO nova.api.openstack.requestlog [None req-9488b852-9c9e-44ea-8a4d-1c10c6253fb9 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.541901 Aug 03 05:05:51.060122 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: [pid: 103803|app: 0|req: 18/34] 10.222.0.40 () {64 vars in 1282 bytes} [Wed Aug 3 05:05:50 2022] POST /compute/v2.1/flavors => generated 408 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 05:05:51.073188 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi [None req-f2ec5bbf-da02-49c8-a131-4cc94d766447 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:05:51.166896 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: INFO nova.api.openstack.requestlog [None req-f2ec5bbf-da02-49c8-a131-4cc94d766447 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.098463 Aug 03 05:05:51.167728 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: [pid: 103804|app: 0|req: 17/35] 10.222.0.40 () {64 vars in 1332 bytes} [Wed Aug 3 05:05:51 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:06:11.117448 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi [None req-9488b852-9c9e-44ea-8a4d-1c10c6253fb9 admin admin] Calling method '>' {{(pid=103803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:11.118717 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: INFO nova.api.openstack.requestlog [None req-9488b852-9c9e-44ea-8a4d-1c10c6253fb9 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001730 Aug 03 05:06:11.119156 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: [pid: 103803|app: 0|req: 19/36] 10.222.0.40 () {54 vars in 930 bytes} [Wed Aug 3 05:06:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:06:11.522260 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi [None req-cbd7c367-6b84-4197-909e-79317561f653 admin admin] Calling method '>' {{(pid=103804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:11.540969 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: INFO nova.api.openstack.requestlog [None req-cbd7c367-6b84-4197-909e-79317561f653 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.415853 Aug 03 05:06:11.541454 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: [pid: 103804|app: 0|req: 18/37] 10.222.0.40 () {60 vars in 1291 bytes} [Wed Aug 3 05:06:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:06:12.606243 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi [None req-9488b852-9c9e-44ea-8a4d-1c10c6253fb9 admin admin] Calling method '>' {{(pid=103803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:12.607297 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: INFO nova.api.openstack.requestlog [None req-9488b852-9c9e-44ea-8a4d-1c10c6253fb9 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Aug 03 05:06:12.607700 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: [pid: 103803|app: 0|req: 20/38] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Aug 3 05:06:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:06:13.128725 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi [None req-949a3135-633e-48c4-9fed-6eac4de8e90a admin admin] Calling method '>' {{(pid=103804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:13.134384 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: INFO nova.api.openstack.wsgi [None req-949a3135-633e-48c4-9fed-6eac4de8e90a admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 03 05:06:13.137634 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi [None req-949a3135-633e-48c4-9fed-6eac4de8e90a admin admin] Request method failure captured: Aug 03 05:06:13.137634 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 03 05:06:13.137634 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: Accept: application/json Aug 03 05:06:13.137634 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: Accept-Encoding: gzip, deflate Aug 03 05:06:13.137634 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: Connection: keep-alive Aug 03 05:06:13.137634 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: Content-Length: 0 Aug 03 05:06:13.137634 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: Host: 10.222.0.40 Aug 03 05:06:13.137634 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: Openstack-Api-Version: compute 2.90 Aug 03 05:06:13.137634 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: Openstack-System-Scope: None Aug 03 05:06:13.137634 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: User-Agent: python-novaclient Aug 03 05:06:13.137634 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: X-Auth-Token: gAAAAABi6gJE0HBfS4oSzGIF6a6Oe-e4T7Cuw1kwmqbQEs1DdahAaB29sXXoRAg_agjSSzaLhagsamAw2dGjwnGKMPycsoa67CTeaVGlF9KiXcwQfa7v2xeOIBpb7jCGLMkO9sLxWXJ93yTIFtpbzQwGoMXrFjDC2v7elXumzhLVgEhdXLAMEPo Aug 03 05:06:13.137634 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: X-Domain-Id: None Aug 03 05:06:13.137634 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: X-Domain-Name: None Aug 03 05:06:13.137634 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: X-Identity-Status: Confirmed Aug 03 05:06:13.137634 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: X-Is-Admin-Project: True Aug 03 05:06:13.137634 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: X-Openstack-Nova-Api-Version: 2.90 Aug 03 05:06:13.137634 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: X-Project-Domain-Id: default Aug 03 05:06:13.137634 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: X-Project-Domain-Name: Default Aug 03 05:06:13.137634 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: X-Project-Id: 6917683e025f412781fd852422d27ce7 Aug 03 05:06:13.137634 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: X-Project-Name: admin Aug 03 05:06:13.137634 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: X-Role: member,reader,admin Aug 03 05:06:13.137634 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: X-Roles: member,reader,admin Aug 03 05:06:13.139339 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6917683e025f412781fd852422d27ce7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6917683e025f412781fd852422d27ce7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6917683e025f412781fd852422d27ce7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6917683e025f412781fd852422d27ce7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:06:13.139339 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: X-Tenant: admin Aug 03 05:06:13.139339 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: X-Tenant-Id: 6917683e025f412781fd852422d27ce7 Aug 03 05:06:13.139339 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: X-Tenant-Name: admin Aug 03 05:06:13.139339 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: X-User: admin Aug 03 05:06:13.139339 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: X-User-Domain-Id: default Aug 03 05:06:13.139339 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: X-User-Domain-Name: Default Aug 03 05:06:13.139339 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: X-User-Id: d53b9368b2734205a2bdcd0bc2796161 Aug 03 05:06:13.139339 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: X-User-Name: admin Aug 03 05:06:13.139339 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: method: > Aug 03 05:06:13.139339 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: exception: Flavor 42 could not be found. Aug 03 05:06:13.139339 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: action_args: {'id': '42'} Aug 03 05:06:13.139339 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: {{(pid=103804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:06:13.139339 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:06:13.140384 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 03 05:06:13.140384 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 03 05:06:13.140384 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 03 05:06:13.140384 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 03 05:06:13.140384 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 05:06:13.140384 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 05:06:13.140384 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 03 05:06:13.140384 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 03 05:06:13.140384 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 03 05:06:13.140384 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:06:13.140384 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 03 05:06:13.140384 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 03 05:06:13.140384 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 03 05:06:13.140384 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi Aug 03 05:06:13.140384 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:06:13.140384 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi Aug 03 05:06:13.140384 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:06:13.140384 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:06:13.140384 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:06:13.141872 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:06:13.141872 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:06:13.141872 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:06:13.141872 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:06:13.141872 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 03 05:06:13.141872 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:06:13.141872 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 03 05:06:13.141872 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi Aug 03 05:06:13.141872 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:06:13.141872 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi Aug 03 05:06:13.141872 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:06:13.141872 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:06:13.141872 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:06:13.141872 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:06:13.141872 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:06:13.141872 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 03 05:06:13.141872 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi Aug 03 05:06:13.141872 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi [None req-949a3135-633e-48c4-9fed-6eac4de8e90a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103804) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:06:13.143189 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: INFO nova.api.openstack.requestlog [None req-949a3135-633e-48c4-9fed-6eac4de8e90a admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.392391 Aug 03 05:06:13.143189 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: [pid: 103804|app: 0|req: 19/39] 10.222.0.40 () {60 vars in 1190 bytes} [Wed Aug 3 05:06:12 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 03 05:06:13.149260 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi [None req-e8c058f9-03c6-4add-a23e-4de606c7b181 admin admin] Calling method '>' {{(pid=103803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:13.172102 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: INFO nova.api.openstack.requestlog [None req-e8c058f9-03c6-4add-a23e-4de606c7b181 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026988 Aug 03 05:06:13.174672 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: [pid: 103803|app: 0|req: 21/40] 10.222.0.40 () {60 vars in 1210 bytes} [Wed Aug 3 05:06:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 05:06:13.182601 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi [None req-5f365155-0dc2-4fec-84c5-7946c3f035a0 admin admin] Calling method '>' {{(pid=103804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:13.206189 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: INFO nova.api.openstack.requestlog [None req-5f365155-0dc2-4fec-84c5-7946c3f035a0 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027421 Aug 03 05:06:13.206736 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: [pid: 103804|app: 0|req: 20/41] 10.222.0.40 () {60 vars in 1210 bytes} [Wed Aug 3 05:06:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:06:13.216972 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi [None req-a752a9b3-8c74-46c5-943c-62b6baa513b6 admin admin] Calling method '>' {{(pid=103803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:13.223870 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: INFO nova.api.openstack.wsgi [None req-a752a9b3-8c74-46c5-943c-62b6baa513b6 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 03 05:06:13.227193 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi [None req-a752a9b3-8c74-46c5-943c-62b6baa513b6 admin admin] Request method failure captured: Aug 03 05:06:13.227193 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 03 05:06:13.227193 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: Accept: application/json Aug 03 05:06:13.227193 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: Accept-Encoding: gzip, deflate Aug 03 05:06:13.227193 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: Connection: keep-alive Aug 03 05:06:13.227193 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: Content-Length: 0 Aug 03 05:06:13.227193 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: Host: 10.222.0.40 Aug 03 05:06:13.227193 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: Openstack-Api-Version: compute 2.90 Aug 03 05:06:13.227193 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: Openstack-System-Scope: None Aug 03 05:06:13.227193 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: User-Agent: python-novaclient Aug 03 05:06:13.227193 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: X-Auth-Token: gAAAAABi6gJE0HBfS4oSzGIF6a6Oe-e4T7Cuw1kwmqbQEs1DdahAaB29sXXoRAg_agjSSzaLhagsamAw2dGjwnGKMPycsoa67CTeaVGlF9KiXcwQfa7v2xeOIBpb7jCGLMkO9sLxWXJ93yTIFtpbzQwGoMXrFjDC2v7elXumzhLVgEhdXLAMEPo Aug 03 05:06:13.227193 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: X-Domain-Id: None Aug 03 05:06:13.227193 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: X-Domain-Name: None Aug 03 05:06:13.227193 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: X-Identity-Status: Confirmed Aug 03 05:06:13.227193 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: X-Is-Admin-Project: True Aug 03 05:06:13.227193 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: X-Openstack-Nova-Api-Version: 2.90 Aug 03 05:06:13.227193 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: X-Project-Domain-Id: default Aug 03 05:06:13.227193 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: X-Project-Domain-Name: Default Aug 03 05:06:13.227193 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: X-Project-Id: 6917683e025f412781fd852422d27ce7 Aug 03 05:06:13.227193 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: X-Project-Name: admin Aug 03 05:06:13.227193 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: X-Role: member,reader,admin Aug 03 05:06:13.227193 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: X-Roles: member,reader,admin Aug 03 05:06:13.236840 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6917683e025f412781fd852422d27ce7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6917683e025f412781fd852422d27ce7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6917683e025f412781fd852422d27ce7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6917683e025f412781fd852422d27ce7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:06:13.236840 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: X-Tenant: admin Aug 03 05:06:13.236840 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: X-Tenant-Id: 6917683e025f412781fd852422d27ce7 Aug 03 05:06:13.236840 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: X-Tenant-Name: admin Aug 03 05:06:13.236840 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: X-User: admin Aug 03 05:06:13.236840 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: X-User-Domain-Id: default Aug 03 05:06:13.236840 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: X-User-Domain-Name: Default Aug 03 05:06:13.236840 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: X-User-Id: d53b9368b2734205a2bdcd0bc2796161 Aug 03 05:06:13.236840 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: X-User-Name: admin Aug 03 05:06:13.236840 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: method: > Aug 03 05:06:13.236840 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: exception: Flavor 42 could not be found. Aug 03 05:06:13.236840 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: action_args: {'id': '42'} Aug 03 05:06:13.236840 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: {{(pid=103803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:06:13.236840 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:06:13.237689 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 03 05:06:13.237689 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 03 05:06:13.237689 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 03 05:06:13.237689 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 03 05:06:13.237689 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 05:06:13.237689 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 05:06:13.237689 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 03 05:06:13.237689 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 03 05:06:13.237689 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 03 05:06:13.237689 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:06:13.237689 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 03 05:06:13.237689 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 03 05:06:13.237689 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 03 05:06:13.237689 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi Aug 03 05:06:13.237689 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:06:13.237689 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi Aug 03 05:06:13.237689 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:06:13.237689 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:06:13.237689 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:06:13.238943 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:06:13.238943 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:06:13.238943 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:06:13.238943 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:06:13.238943 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 03 05:06:13.238943 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:06:13.238943 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 03 05:06:13.238943 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi Aug 03 05:06:13.238943 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:06:13.238943 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi Aug 03 05:06:13.238943 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:06:13.238943 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:06:13.238943 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:06:13.238943 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:06:13.238943 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:06:13.238943 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 03 05:06:13.238943 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi Aug 03 05:06:13.238943 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi [None req-a752a9b3-8c74-46c5-943c-62b6baa513b6 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103803) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:06:13.240058 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: INFO nova.api.openstack.requestlog [None req-a752a9b3-8c74-46c5-943c-62b6baa513b6 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015592 Aug 03 05:06:13.240058 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: [pid: 103803|app: 0|req: 22/42] 10.222.0.40 () {60 vars in 1190 bytes} [Wed Aug 3 05:06:13 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 03 05:06:14.209561 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi [None req-5f365155-0dc2-4fec-84c5-7946c3f035a0 admin admin] Calling method '>' {{(pid=103804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:14.210575 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: INFO nova.api.openstack.requestlog [None req-5f365155-0dc2-4fec-84c5-7946c3f035a0 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Aug 03 05:06:14.210996 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: [pid: 103804|app: 0|req: 21/43] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Aug 3 05:06:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:06:14.753862 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi [None req-09b70a32-ef62-4729-bd82-fbf592f482db admin admin] Calling method '>' {{(pid=103803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:14.759851 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: INFO nova.api.openstack.wsgi [None req-09b70a32-ef62-4729-bd82-fbf592f482db admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 03 05:06:14.761366 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi [None req-09b70a32-ef62-4729-bd82-fbf592f482db admin admin] Request method failure captured: Aug 03 05:06:14.761366 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 03 05:06:14.761366 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: Accept: application/json Aug 03 05:06:14.761366 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: Accept-Encoding: gzip, deflate Aug 03 05:06:14.761366 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: Connection: keep-alive Aug 03 05:06:14.761366 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: Content-Length: 0 Aug 03 05:06:14.761366 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: Host: 10.222.0.40 Aug 03 05:06:14.761366 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: Openstack-Api-Version: compute 2.90 Aug 03 05:06:14.761366 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: Openstack-System-Scope: None Aug 03 05:06:14.761366 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: User-Agent: python-novaclient Aug 03 05:06:14.761366 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: X-Auth-Token: gAAAAABi6gJGbMJgIKr5PeEuIgS_obzsdF8BjkNXYJ4OYCf_ozXCakWj_MdR3zRKkSCjAEYFoqm81i0cyRq9p83mkDj6OHPAv-IiFeilUTR6sOGj5G8kjnWLumRN0B8KL8DDS95uuX1MZLvPb3VExoejmM3LUwyWEx_t_wXymQNdk3HW1pE_i8E Aug 03 05:06:14.761366 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: X-Domain-Id: None Aug 03 05:06:14.761366 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: X-Domain-Name: None Aug 03 05:06:14.761366 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: X-Identity-Status: Confirmed Aug 03 05:06:14.761366 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: X-Is-Admin-Project: True Aug 03 05:06:14.761366 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: X-Openstack-Nova-Api-Version: 2.90 Aug 03 05:06:14.761366 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: X-Project-Domain-Id: default Aug 03 05:06:14.761366 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: X-Project-Domain-Name: Default Aug 03 05:06:14.761366 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: X-Project-Id: 6917683e025f412781fd852422d27ce7 Aug 03 05:06:14.761366 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: X-Project-Name: admin Aug 03 05:06:14.761366 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: X-Role: member,reader,admin Aug 03 05:06:14.761366 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: X-Roles: member,reader,admin Aug 03 05:06:14.762953 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6917683e025f412781fd852422d27ce7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6917683e025f412781fd852422d27ce7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6917683e025f412781fd852422d27ce7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6917683e025f412781fd852422d27ce7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:06:14.762953 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: X-Tenant: admin Aug 03 05:06:14.762953 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: X-Tenant-Id: 6917683e025f412781fd852422d27ce7 Aug 03 05:06:14.762953 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: X-Tenant-Name: admin Aug 03 05:06:14.762953 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: X-User: admin Aug 03 05:06:14.762953 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: X-User-Domain-Id: default Aug 03 05:06:14.762953 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: X-User-Domain-Name: Default Aug 03 05:06:14.762953 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: X-User-Id: d53b9368b2734205a2bdcd0bc2796161 Aug 03 05:06:14.762953 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: X-User-Name: admin Aug 03 05:06:14.762953 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: method: > Aug 03 05:06:14.762953 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: exception: Flavor 84 could not be found. Aug 03 05:06:14.762953 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: action_args: {'id': '84'} Aug 03 05:06:14.762953 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: {{(pid=103803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:06:14.762953 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:06:14.763957 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 03 05:06:14.763957 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 03 05:06:14.763957 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 03 05:06:14.763957 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 03 05:06:14.763957 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 05:06:14.763957 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 05:06:14.763957 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 03 05:06:14.763957 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 03 05:06:14.763957 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 03 05:06:14.763957 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:06:14.763957 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 03 05:06:14.763957 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 03 05:06:14.763957 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 03 05:06:14.763957 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi Aug 03 05:06:14.763957 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:06:14.763957 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi Aug 03 05:06:14.763957 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:06:14.763957 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:06:14.763957 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:06:14.765315 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:06:14.765315 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:06:14.765315 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:06:14.765315 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:06:14.765315 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 03 05:06:14.765315 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:06:14.765315 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 03 05:06:14.765315 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi Aug 03 05:06:14.765315 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:06:14.765315 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi Aug 03 05:06:14.765315 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:06:14.765315 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:06:14.765315 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:06:14.765315 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:06:14.765315 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:06:14.765315 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 03 05:06:14.765315 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi Aug 03 05:06:14.765315 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi [None req-09b70a32-ef62-4729-bd82-fbf592f482db admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103803) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:06:14.766564 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: INFO nova.api.openstack.requestlog [None req-09b70a32-ef62-4729-bd82-fbf592f482db admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.408445 Aug 03 05:06:14.766564 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: [pid: 103803|app: 0|req: 23/44] 10.222.0.40 () {60 vars in 1190 bytes} [Wed Aug 3 05:06:14 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 410 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 03 05:06:14.772493 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi [None req-6b39afc3-e7ec-4829-9f39-42595ac2a53e admin admin] Calling method '>' {{(pid=103804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:14.787229 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: INFO nova.api.openstack.requestlog [None req-6b39afc3-e7ec-4829-9f39-42595ac2a53e admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018258 Aug 03 05:06:14.787758 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: [pid: 103804|app: 0|req: 22/45] 10.222.0.40 () {60 vars in 1210 bytes} [Wed Aug 3 05:06:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:06:14.797072 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi [None req-a8a51049-f028-4aff-8877-c4624c5cd6cc admin admin] Calling method '>' {{(pid=103803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:14.812363 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: INFO nova.api.openstack.requestlog [None req-a8a51049-f028-4aff-8877-c4624c5cd6cc admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018808 Aug 03 05:06:14.812904 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: [pid: 103803|app: 0|req: 24/46] 10.222.0.40 () {60 vars in 1210 bytes} [Wed Aug 3 05:06:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:06:14.822486 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi [None req-81ead73f-7815-49b0-80f4-a5c24b6ce2b8 admin admin] Calling method '>' {{(pid=103804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:14.827761 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: INFO nova.api.openstack.wsgi [None req-81ead73f-7815-49b0-80f4-a5c24b6ce2b8 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 03 05:06:14.829244 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi [None req-81ead73f-7815-49b0-80f4-a5c24b6ce2b8 admin admin] Request method failure captured: Aug 03 05:06:14.829244 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 03 05:06:14.829244 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: Accept: application/json Aug 03 05:06:14.829244 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: Accept-Encoding: gzip, deflate Aug 03 05:06:14.829244 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: Connection: keep-alive Aug 03 05:06:14.829244 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: Content-Length: 0 Aug 03 05:06:14.829244 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: Host: 10.222.0.40 Aug 03 05:06:14.829244 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: Openstack-Api-Version: compute 2.90 Aug 03 05:06:14.829244 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: Openstack-System-Scope: None Aug 03 05:06:14.829244 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: User-Agent: python-novaclient Aug 03 05:06:14.829244 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: X-Auth-Token: gAAAAABi6gJGbMJgIKr5PeEuIgS_obzsdF8BjkNXYJ4OYCf_ozXCakWj_MdR3zRKkSCjAEYFoqm81i0cyRq9p83mkDj6OHPAv-IiFeilUTR6sOGj5G8kjnWLumRN0B8KL8DDS95uuX1MZLvPb3VExoejmM3LUwyWEx_t_wXymQNdk3HW1pE_i8E Aug 03 05:06:14.829244 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: X-Domain-Id: None Aug 03 05:06:14.829244 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: X-Domain-Name: None Aug 03 05:06:14.829244 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: X-Identity-Status: Confirmed Aug 03 05:06:14.829244 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: X-Is-Admin-Project: True Aug 03 05:06:14.829244 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: X-Openstack-Nova-Api-Version: 2.90 Aug 03 05:06:14.829244 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: X-Project-Domain-Id: default Aug 03 05:06:14.829244 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: X-Project-Domain-Name: Default Aug 03 05:06:14.829244 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: X-Project-Id: 6917683e025f412781fd852422d27ce7 Aug 03 05:06:14.829244 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: X-Project-Name: admin Aug 03 05:06:14.829244 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: X-Role: member,reader,admin Aug 03 05:06:14.829244 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: X-Roles: member,reader,admin Aug 03 05:06:14.830755 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6917683e025f412781fd852422d27ce7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6917683e025f412781fd852422d27ce7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6917683e025f412781fd852422d27ce7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6917683e025f412781fd852422d27ce7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:06:14.830755 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: X-Tenant: admin Aug 03 05:06:14.830755 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: X-Tenant-Id: 6917683e025f412781fd852422d27ce7 Aug 03 05:06:14.830755 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: X-Tenant-Name: admin Aug 03 05:06:14.830755 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: X-User: admin Aug 03 05:06:14.830755 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: X-User-Domain-Id: default Aug 03 05:06:14.830755 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: X-User-Domain-Name: Default Aug 03 05:06:14.830755 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: X-User-Id: d53b9368b2734205a2bdcd0bc2796161 Aug 03 05:06:14.830755 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: X-User-Name: admin Aug 03 05:06:14.830755 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: method: > Aug 03 05:06:14.830755 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: exception: Flavor 84 could not be found. Aug 03 05:06:14.830755 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: action_args: {'id': '84'} Aug 03 05:06:14.830755 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: {{(pid=103804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:06:14.830755 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:06:14.831746 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 03 05:06:14.831746 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 03 05:06:14.831746 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 03 05:06:14.831746 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 03 05:06:14.831746 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 05:06:14.831746 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 05:06:14.831746 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 03 05:06:14.831746 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 03 05:06:14.831746 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 03 05:06:14.831746 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:06:14.831746 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 03 05:06:14.831746 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 03 05:06:14.831746 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 03 05:06:14.831746 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi Aug 03 05:06:14.831746 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:06:14.831746 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi Aug 03 05:06:14.831746 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:06:14.831746 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:06:14.831746 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:06:14.833204 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:06:14.833204 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:06:14.833204 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:06:14.833204 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:06:14.833204 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 03 05:06:14.833204 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:06:14.833204 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 03 05:06:14.833204 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi Aug 03 05:06:14.833204 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:06:14.833204 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi Aug 03 05:06:14.833204 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:06:14.833204 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:06:14.833204 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:06:14.833204 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:06:14.833204 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:06:14.833204 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 03 05:06:14.833204 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi Aug 03 05:06:14.833204 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi [None req-81ead73f-7815-49b0-80f4-a5c24b6ce2b8 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103804) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:06:14.834636 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: INFO nova.api.openstack.requestlog [None req-81ead73f-7815-49b0-80f4-a5c24b6ce2b8 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011549 Aug 03 05:06:14.834636 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: [pid: 103804|app: 0|req: 23/47] 10.222.0.40 () {60 vars in 1190 bytes} [Wed Aug 3 05:06:14 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 03 05:06:15.793559 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi [None req-a8a51049-f028-4aff-8877-c4624c5cd6cc admin admin] Calling method '>' {{(pid=103803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:15.794568 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: INFO nova.api.openstack.requestlog [None req-a8a51049-f028-4aff-8877-c4624c5cd6cc admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Aug 03 05:06:15.794991 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: [pid: 103803|app: 0|req: 25/48] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Aug 3 05:06:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:06:16.325588 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi [None req-a9f4c77d-de3e-4766-a67e-f61cd26015fe admin admin] Calling method '>' {{(pid=103804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:16.331358 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: INFO nova.api.openstack.wsgi [None req-a9f4c77d-de3e-4766-a67e-f61cd26015fe admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 03 05:06:16.333254 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi [None req-a9f4c77d-de3e-4766-a67e-f61cd26015fe admin admin] Request method failure captured: Aug 03 05:06:16.333254 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 03 05:06:16.333254 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: Accept: application/json Aug 03 05:06:16.333254 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: Accept-Encoding: gzip, deflate Aug 03 05:06:16.333254 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: Connection: keep-alive Aug 03 05:06:16.333254 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: Content-Length: 0 Aug 03 05:06:16.333254 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: Host: 10.222.0.40 Aug 03 05:06:16.333254 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: Openstack-Api-Version: compute 2.90 Aug 03 05:06:16.333254 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: Openstack-System-Scope: None Aug 03 05:06:16.333254 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: User-Agent: python-novaclient Aug 03 05:06:16.333254 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: X-Auth-Token: gAAAAABi6gJHJ0R16ez2WDRZZyRR9GhG9gJydPlSYwXxf_XEP65Yrt5Xi_XkEe10xHpyZga8Xx6hFKYfXXLs0wTUGrtzv_ThUVmEbDj-ISe01nyXoHTn8qvL_BFRGDK2QtpCrcLFcLE0TEcAO-ZI8a_p8GH3DYQ1s2hvuaqztw-5YSsv_lRdgJU Aug 03 05:06:16.333254 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: X-Domain-Id: None Aug 03 05:06:16.333254 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: X-Domain-Name: None Aug 03 05:06:16.333254 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: X-Identity-Status: Confirmed Aug 03 05:06:16.333254 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: X-Is-Admin-Project: True Aug 03 05:06:16.333254 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: X-Openstack-Nova-Api-Version: 2.90 Aug 03 05:06:16.333254 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: X-Project-Domain-Id: default Aug 03 05:06:16.333254 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: X-Project-Domain-Name: Default Aug 03 05:06:16.333254 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: X-Project-Id: 6917683e025f412781fd852422d27ce7 Aug 03 05:06:16.333254 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: X-Project-Name: admin Aug 03 05:06:16.333254 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: X-Role: member,reader,admin Aug 03 05:06:16.333254 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: X-Roles: member,reader,admin Aug 03 05:06:16.335257 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6917683e025f412781fd852422d27ce7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6917683e025f412781fd852422d27ce7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6917683e025f412781fd852422d27ce7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6917683e025f412781fd852422d27ce7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:06:16.335257 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: X-Tenant: admin Aug 03 05:06:16.335257 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: X-Tenant-Id: 6917683e025f412781fd852422d27ce7 Aug 03 05:06:16.335257 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: X-Tenant-Name: admin Aug 03 05:06:16.335257 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: X-User: admin Aug 03 05:06:16.335257 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: X-User-Domain-Id: default Aug 03 05:06:16.335257 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: X-User-Domain-Name: Default Aug 03 05:06:16.335257 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: X-User-Id: d53b9368b2734205a2bdcd0bc2796161 Aug 03 05:06:16.335257 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: X-User-Name: admin Aug 03 05:06:16.335257 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: method: > Aug 03 05:06:16.335257 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: exception: Flavor 451 could not be found. Aug 03 05:06:16.335257 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: action_args: {'id': '451'} Aug 03 05:06:16.335257 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: {{(pid=103804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:06:16.335257 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:06:16.336092 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 03 05:06:16.336092 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 03 05:06:16.336092 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 03 05:06:16.336092 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 03 05:06:16.336092 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 05:06:16.336092 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 05:06:16.336092 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 03 05:06:16.336092 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 03 05:06:16.336092 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 03 05:06:16.336092 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:06:16.336092 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 03 05:06:16.336092 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 03 05:06:16.336092 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 03 05:06:16.336092 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi Aug 03 05:06:16.336092 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:06:16.336092 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi Aug 03 05:06:16.336092 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:06:16.336092 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:06:16.336092 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:06:16.337179 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:06:16.337179 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:06:16.337179 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:06:16.337179 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:06:16.337179 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 03 05:06:16.337179 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:06:16.337179 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 03 05:06:16.337179 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi Aug 03 05:06:16.337179 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:06:16.337179 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi Aug 03 05:06:16.337179 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:06:16.337179 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:06:16.337179 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:06:16.337179 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:06:16.337179 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:06:16.337179 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 03 05:06:16.337179 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: ERROR nova.api.openstack.wsgi Aug 03 05:06:16.337179 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi [None req-a9f4c77d-de3e-4766-a67e-f61cd26015fe admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103804) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:06:16.338448 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: INFO nova.api.openstack.requestlog [None req-a9f4c77d-de3e-4766-a67e-f61cd26015fe admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.398751 Aug 03 05:06:16.338448 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: [pid: 103804|app: 0|req: 24/49] 10.222.0.40 () {60 vars in 1193 bytes} [Wed Aug 3 05:06:15 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 03 05:06:16.344977 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi [None req-36192161-8b22-4f63-8474-d191a4771f4a admin admin] Calling method '>' {{(pid=103803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:16.359800 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: INFO nova.api.openstack.requestlog [None req-36192161-8b22-4f63-8474-d191a4771f4a admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018492 Aug 03 05:06:16.360326 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: [pid: 103803|app: 0|req: 26/50] 10.222.0.40 () {60 vars in 1210 bytes} [Wed Aug 3 05:06:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:06:16.369846 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi [None req-2bf1d588-1ccb-47af-b3fc-69d76322d1b4 admin admin] Calling method '>' {{(pid=103804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:16.385150 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: INFO nova.api.openstack.requestlog [None req-2bf1d588-1ccb-47af-b3fc-69d76322d1b4 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019039 Aug 03 05:06:16.385686 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: [pid: 103804|app: 0|req: 25/51] 10.222.0.40 () {60 vars in 1210 bytes} [Wed Aug 3 05:06:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 05:06:16.395491 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi [None req-76096e23-7ad4-4788-abd5-584e952239ad admin admin] Calling method '>' {{(pid=103803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:16.400853 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: INFO nova.api.openstack.wsgi [None req-76096e23-7ad4-4788-abd5-584e952239ad admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 03 05:06:16.402353 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi [None req-76096e23-7ad4-4788-abd5-584e952239ad admin admin] Request method failure captured: Aug 03 05:06:16.402353 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 03 05:06:16.402353 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: Accept: application/json Aug 03 05:06:16.402353 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: Accept-Encoding: gzip, deflate Aug 03 05:06:16.402353 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: Connection: keep-alive Aug 03 05:06:16.402353 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: Content-Length: 0 Aug 03 05:06:16.402353 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: Host: 10.222.0.40 Aug 03 05:06:16.402353 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: Openstack-Api-Version: compute 2.90 Aug 03 05:06:16.402353 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: Openstack-System-Scope: None Aug 03 05:06:16.402353 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: User-Agent: python-novaclient Aug 03 05:06:16.402353 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: X-Auth-Token: gAAAAABi6gJHJ0R16ez2WDRZZyRR9GhG9gJydPlSYwXxf_XEP65Yrt5Xi_XkEe10xHpyZga8Xx6hFKYfXXLs0wTUGrtzv_ThUVmEbDj-ISe01nyXoHTn8qvL_BFRGDK2QtpCrcLFcLE0TEcAO-ZI8a_p8GH3DYQ1s2hvuaqztw-5YSsv_lRdgJU Aug 03 05:06:16.402353 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: X-Domain-Id: None Aug 03 05:06:16.402353 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: X-Domain-Name: None Aug 03 05:06:16.402353 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: X-Identity-Status: Confirmed Aug 03 05:06:16.402353 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: X-Is-Admin-Project: True Aug 03 05:06:16.402353 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: X-Openstack-Nova-Api-Version: 2.90 Aug 03 05:06:16.402353 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: X-Project-Domain-Id: default Aug 03 05:06:16.402353 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: X-Project-Domain-Name: Default Aug 03 05:06:16.402353 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: X-Project-Id: 6917683e025f412781fd852422d27ce7 Aug 03 05:06:16.402353 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: X-Project-Name: admin Aug 03 05:06:16.402353 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: X-Role: member,reader,admin Aug 03 05:06:16.402353 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: X-Roles: member,reader,admin Aug 03 05:06:16.403892 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6917683e025f412781fd852422d27ce7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6917683e025f412781fd852422d27ce7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6917683e025f412781fd852422d27ce7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6917683e025f412781fd852422d27ce7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:06:16.403892 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: X-Tenant: admin Aug 03 05:06:16.403892 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: X-Tenant-Id: 6917683e025f412781fd852422d27ce7 Aug 03 05:06:16.403892 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: X-Tenant-Name: admin Aug 03 05:06:16.403892 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: X-User: admin Aug 03 05:06:16.403892 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: X-User-Domain-Id: default Aug 03 05:06:16.403892 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: X-User-Domain-Name: Default Aug 03 05:06:16.403892 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: X-User-Id: d53b9368b2734205a2bdcd0bc2796161 Aug 03 05:06:16.403892 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: X-User-Name: admin Aug 03 05:06:16.403892 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: method: > Aug 03 05:06:16.403892 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: exception: Flavor 451 could not be found. Aug 03 05:06:16.403892 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: action_args: {'id': '451'} Aug 03 05:06:16.403892 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: {{(pid=103803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:06:16.403892 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:06:16.404882 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 03 05:06:16.404882 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 03 05:06:16.404882 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 03 05:06:16.404882 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 03 05:06:16.404882 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 05:06:16.404882 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 05:06:16.404882 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 03 05:06:16.404882 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 03 05:06:16.404882 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 03 05:06:16.404882 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:06:16.404882 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 03 05:06:16.404882 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 03 05:06:16.404882 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 03 05:06:16.404882 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi Aug 03 05:06:16.404882 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:06:16.404882 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi Aug 03 05:06:16.404882 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:06:16.404882 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:06:16.404882 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:06:16.406096 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:06:16.406096 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:06:16.406096 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:06:16.406096 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:06:16.406096 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 03 05:06:16.406096 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:06:16.406096 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 03 05:06:16.406096 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi Aug 03 05:06:16.406096 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:06:16.406096 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi Aug 03 05:06:16.406096 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:06:16.406096 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:06:16.406096 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:06:16.406096 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:06:16.406096 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:06:16.406096 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 03 05:06:16.406096 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: ERROR nova.api.openstack.wsgi Aug 03 05:06:16.406096 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi [None req-76096e23-7ad4-4788-abd5-584e952239ad admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103803) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:06:16.407380 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: INFO nova.api.openstack.requestlog [None req-76096e23-7ad4-4788-abd5-584e952239ad admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012471 Aug 03 05:06:16.407380 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: [pid: 103803|app: 0|req: 27/52] 10.222.0.40 () {60 vars in 1193 bytes} [Wed Aug 3 05:06:16 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 03 05:06:17.378821 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi [None req-2bf1d588-1ccb-47af-b3fc-69d76322d1b4 admin admin] Calling method '>' {{(pid=103804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:17.379931 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: INFO nova.api.openstack.requestlog [None req-2bf1d588-1ccb-47af-b3fc-69d76322d1b4 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Aug 03 05:06:17.380330 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: [pid: 103804|app: 0|req: 26/53] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Aug 3 05:06:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:06:17.915965 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi [None req-6b03531e-3465-47ee-b90c-d65836cbeda2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:06:17.989758 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: INFO nova.api.openstack.requestlog [None req-6b03531e-3465-47ee-b90c-d65836cbeda2 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.467369 Aug 03 05:06:17.990324 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: [pid: 103803|app: 0|req: 28/54] 10.222.0.40 () {64 vars in 1235 bytes} [Wed Aug 3 05:06:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 05:06:19.102827 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi [None req-2bf1d588-1ccb-47af-b3fc-69d76322d1b4 admin admin] Calling method '>' {{(pid=103804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:19.103854 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: INFO nova.api.openstack.requestlog [None req-2bf1d588-1ccb-47af-b3fc-69d76322d1b4 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Aug 03 05:06:19.104300 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: [pid: 103804|app: 0|req: 27/55] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Aug 3 05:06:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:06:19.645710 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi [None req-650b2acd-baea-4fb2-8ddf-a87e44a89d6a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:06:19.721352 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: INFO nova.api.openstack.requestlog [None req-650b2acd-baea-4fb2-8ddf-a87e44a89d6a admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.479061 Aug 03 05:06:19.721911 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: [pid: 103803|app: 0|req: 29/56] 10.222.0.40 () {64 vars in 1235 bytes} [Wed Aug 3 05:06:19 2022] POST /compute/v2.1/flavors => generated 405 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 05:06:20.694689 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi [None req-2bf1d588-1ccb-47af-b3fc-69d76322d1b4 admin admin] Calling method '>' {{(pid=103804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:20.695788 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: INFO nova.api.openstack.requestlog [None req-2bf1d588-1ccb-47af-b3fc-69d76322d1b4 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Aug 03 05:06:20.696194 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: [pid: 103804|app: 0|req: 28/57] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Aug 3 05:06:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:06:21.220671 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi [None req-2ffa79a3-6124-47ba-94e1-f9208bf236c6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:06:21.300471 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: INFO nova.api.openstack.requestlog [None req-2ffa79a3-6124-47ba-94e1-f9208bf236c6 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.462992 Aug 03 05:06:21.301547 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: [pid: 103803|app: 0|req: 30/58] 10.222.0.40 () {64 vars in 1235 bytes} [Wed Aug 3 05:06:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 05:06:22.266945 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi [None req-2bf1d588-1ccb-47af-b3fc-69d76322d1b4 admin admin] Calling method '>' {{(pid=103804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:22.267547 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: INFO nova.api.openstack.requestlog [None req-2bf1d588-1ccb-47af-b3fc-69d76322d1b4 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001689 Aug 03 05:06:22.267951 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: [pid: 103804|app: 0|req: 29/59] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Aug 3 05:06:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:06:22.803581 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi [None req-19a9e512-248c-4308-9c90-f44e15fad2c3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:06:22.881747 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: INFO nova.api.openstack.requestlog [None req-19a9e512-248c-4308-9c90-f44e15fad2c3 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.475149 Aug 03 05:06:22.882239 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: [pid: 103803|app: 0|req: 31/60] 10.222.0.40 () {64 vars in 1235 bytes} [Wed Aug 3 05:06:22 2022] POST /compute/v2.1/flavors => generated 409 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 05:06:23.856678 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi [None req-2bf1d588-1ccb-47af-b3fc-69d76322d1b4 admin admin] Calling method '>' {{(pid=103804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:23.857722 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: INFO nova.api.openstack.requestlog [None req-2bf1d588-1ccb-47af-b3fc-69d76322d1b4 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Aug 03 05:06:23.858130 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: [pid: 103804|app: 0|req: 30/61] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Aug 3 05:06:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:06:24.399047 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi [None req-ef2ae047-5df8-456c-bfe4-927ee002793b admin admin] Calling method '>' {{(pid=103803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:24.420073 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: INFO nova.api.openstack.requestlog [None req-ef2ae047-5df8-456c-bfe4-927ee002793b admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.422734 Aug 03 05:06:24.420611 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: [pid: 103803|app: 0|req: 32/62] 10.222.0.40 () {60 vars in 1202 bytes} [Wed Aug 3 05:06:23 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:07:16.203561 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi [None req-2bf1d588-1ccb-47af-b3fc-69d76322d1b4 admin admin] Calling method '>' {{(pid=103804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:07:16.204998 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: INFO nova.api.openstack.requestlog [None req-2bf1d588-1ccb-47af-b3fc-69d76322d1b4 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001976 Aug 03 05:07:16.205407 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: [pid: 103804|app: 0|req: 31/63] 10.222.0.40 () {54 vars in 930 bytes} [Wed Aug 3 05:07:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:07:16.215927 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG dbcounter [-] [103803] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=103803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:07:16.596385 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi [None req-7e09d689-6bfb-495b-9923-d5e534fb6961 admin admin] Calling method '>' {{(pid=103803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:07:16.617892 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: INFO nova.api.openstack.requestlog [None req-7e09d689-6bfb-495b-9923-d5e534fb6961 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.406723 Aug 03 05:07:16.618437 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: [pid: 103803|app: 0|req: 33/64] 10.222.0.40 () {60 vars in 1291 bytes} [Wed Aug 3 05:07:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:07:16.638819 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG dbcounter [-] [103804] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:07:16.642535 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi [None req-11f67033-5011-45dd-9ab7-f3b0871dc284 admin admin] Calling method '>' {{(pid=103804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:07:16.650042 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: INFO nova.api.openstack.requestlog [None req-11f67033-5011-45dd-9ab7-f3b0871dc284 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012666 Aug 03 05:07:16.653447 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: [pid: 103804|app: 0|req: 32/65] 10.222.0.40 () {60 vars in 1282 bytes} [Wed Aug 3 05:07:16 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:07:16.663325 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi [None req-828d9b64-130f-4f65-bd72-354b22d8c445 admin admin] Calling method '>' {{(pid=103803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:07:16.671207 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: INFO nova.api.openstack.requestlog [None req-828d9b64-130f-4f65-bd72-354b22d8c445 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011742 Aug 03 05:07:16.671718 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: [pid: 103803|app: 0|req: 34/66] 10.222.0.40 () {60 vars in 1285 bytes} [Wed Aug 3 05:07:16 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:07:16.684090 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi [None req-fcadcb06-5b82-4455-b8d2-08f4334a7437 admin admin] Calling method '>' {{(pid=103804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:07:16.691849 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: INFO nova.api.openstack.requestlog [None req-fcadcb06-5b82-4455-b8d2-08f4334a7437 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011395 Aug 03 05:07:16.692412 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: [pid: 103804|app: 0|req: 33/67] 10.222.0.40 () {60 vars in 1285 bytes} [Wed Aug 3 05:07:16 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:07:16.706231 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi [None req-ac238db6-e8f8-4f33-9b78-15f83002db6b admin admin] Calling method '>' {{(pid=103803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:07:16.713995 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: INFO nova.api.openstack.requestlog [None req-ac238db6-e8f8-4f33-9b78-15f83002db6b admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012204 Aug 03 05:07:16.714531 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: [pid: 103803|app: 0|req: 35/68] 10.222.0.40 () {60 vars in 1282 bytes} [Wed Aug 3 05:07:16 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:46.362081 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi [None req-fcadcb06-5b82-4455-b8d2-08f4334a7437 admin admin] Calling method '>' {{(pid=103804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:46.363138 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: INFO nova.api.openstack.requestlog [None req-fcadcb06-5b82-4455-b8d2-08f4334a7437 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Aug 03 05:10:46.363589 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: [pid: 103804|app: 0|req: 34/69] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Aug 3 05:10:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:10:46.502931 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG dbcounter [-] [103803] Writing DB stats nova_api:SELECT=6 {{(pid=103803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:10:46.665933 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi [None req-06b5767a-8dbc-435b-b6e9-99f927b445ae admin admin] Calling method '>' {{(pid=103803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:46.668419 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 05:10:46.668419 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: warnings.warn(msg) Aug 03 05:10:46.669638 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG oslo_concurrency.lockutils [None req-06b5767a-8dbc-435b-b6e9-99f927b445ae admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103803) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:46.670088 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG oslo_concurrency.lockutils [None req-06b5767a-8dbc-435b-b6e9-99f927b445ae admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103803) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:46.670976 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG oslo_concurrency.lockutils [None req-06b5767a-8dbc-435b-b6e9-99f927b445ae admin admin] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103803) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:46.671414 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG oslo_concurrency.lockutils [None req-06b5767a-8dbc-435b-b6e9-99f927b445ae admin admin] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103803) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:46.705519 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: INFO nova.api.openstack.requestlog [None req-06b5767a-8dbc-435b-b6e9-99f927b445ae admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.204111 Aug 03 05:10:46.706092 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: [pid: 103803|app: 0|req: 36/70] 10.222.0.40 () {60 vars in 1193 bytes} [Wed Aug 3 05:10:46 2022] GET /compute/v2.1/os-services => generated 791 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 05:10:47.543525 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi [None req-fcadcb06-5b82-4455-b8d2-08f4334a7437 admin admin] Calling method '>' {{(pid=103804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:47.544837 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: INFO nova.api.openstack.requestlog [None req-fcadcb06-5b82-4455-b8d2-08f4334a7437 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001602 Aug 03 05:10:47.545258 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: [pid: 103804|app: 0|req: 35/71] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Aug 3 05:10:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:10:47.739767 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi [None req-2e3e6404-e3a2-4553-a063-3ac72bc19f5d admin admin] Calling method '>' {{(pid=103803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:47.742235 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 05:10:47.742235 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: warnings.warn(msg) Aug 03 05:10:47.743489 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG oslo_concurrency.lockutils [None req-2e3e6404-e3a2-4553-a063-3ac72bc19f5d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103803) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:47.744532 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG oslo_concurrency.lockutils [None req-2e3e6404-e3a2-4553-a063-3ac72bc19f5d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103803) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:47.745346 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG oslo_concurrency.lockutils [None req-2e3e6404-e3a2-4553-a063-3ac72bc19f5d admin admin] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103803) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:47.745783 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG oslo_concurrency.lockutils [None req-2e3e6404-e3a2-4553-a063-3ac72bc19f5d admin admin] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103803) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:47.769042 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: INFO nova.api.openstack.requestlog [None req-2e3e6404-e3a2-4553-a063-3ac72bc19f5d admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077831 Aug 03 05:10:47.769042 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: [pid: 103803|app: 0|req: 37/72] 10.222.0.40 () {60 vars in 1193 bytes} [Wed Aug 3 05:10:47 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 05:10:59.011613 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi [None req-fcadcb06-5b82-4455-b8d2-08f4334a7437 admin admin] Calling method '>' {{(pid=103804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:59.012654 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: INFO nova.api.openstack.requestlog [None req-fcadcb06-5b82-4455-b8d2-08f4334a7437 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Aug 03 05:10:59.013060 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: [pid: 103804|app: 0|req: 36/73] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Aug 3 05:10:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:10:59.156661 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG dbcounter [-] [103803] Writing DB stats nova_cell0:SELECT=4 {{(pid=103803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:10:59.157391 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG dbcounter [-] [103803] Writing DB stats nova_cell1:SELECT=4 {{(pid=103803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:10:59.158040 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG dbcounter [-] [103803] Writing DB stats nova_api:SELECT=8 {{(pid=103803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:10:59.206797 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi [None req-1f8ca617-601a-4886-8f93-8454acef0df3 admin admin] Calling method '>' {{(pid=103803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:59.209195 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 05:10:59.209195 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: warnings.warn(msg) Aug 03 05:10:59.210432 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG oslo_concurrency.lockutils [None req-1f8ca617-601a-4886-8f93-8454acef0df3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103803) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:59.210905 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG oslo_concurrency.lockutils [None req-1f8ca617-601a-4886-8f93-8454acef0df3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103803) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:59.211709 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG oslo_concurrency.lockutils [None req-1f8ca617-601a-4886-8f93-8454acef0df3 admin admin] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103803) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:59.212145 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG oslo_concurrency.lockutils [None req-1f8ca617-601a-4886-8f93-8454acef0df3 admin admin] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103803) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:59.237400 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: INFO nova.api.openstack.requestlog [None req-1f8ca617-601a-4886-8f93-8454acef0df3 admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.085184 Aug 03 05:10:59.237890 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: [pid: 103803|app: 0|req: 38/74] 10.222.0.40 () {60 vars in 1193 bytes} [Wed Aug 3 05:10:59 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:11:00.066485 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: DEBUG nova.api.openstack.wsgi [None req-fcadcb06-5b82-4455-b8d2-08f4334a7437 admin admin] Calling method '>' {{(pid=103804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:11:00.067549 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: INFO nova.api.openstack.requestlog [None req-fcadcb06-5b82-4455-b8d2-08f4334a7437 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Aug 03 05:11:00.067952 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: [pid: 103804|app: 0|req: 37/75] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Aug 3 05:11:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:11:00.261662 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG nova.api.openstack.wsgi [None req-c1085c15-3576-418a-8e50-a8b90a0aae93 admin admin] Calling method '>' {{(pid=103803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:11:00.264045 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 05:11:00.264045 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: warnings.warn(msg) Aug 03 05:11:00.265276 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG oslo_concurrency.lockutils [None req-c1085c15-3576-418a-8e50-a8b90a0aae93 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103803) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:00.265723 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG oslo_concurrency.lockutils [None req-c1085c15-3576-418a-8e50-a8b90a0aae93 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103803) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:00.266512 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG oslo_concurrency.lockutils [None req-c1085c15-3576-418a-8e50-a8b90a0aae93 admin admin] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103803) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:00.266977 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: DEBUG oslo_concurrency.lockutils [None req-c1085c15-3576-418a-8e50-a8b90a0aae93 admin admin] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103803) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:00.288795 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: INFO nova.api.openstack.requestlog [None req-c1085c15-3576-418a-8e50-a8b90a0aae93 admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079665 Aug 03 05:11:00.289284 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: [pid: 103803|app: 0|req: 39/76] 10.222.0.40 () {60 vars in 1193 bytes} [Wed Aug 3 05:11:00 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 05:11:56.066418 dv-cinder-851279-4-iscsi devstack@n-api.service[103802]: Wed Aug 3 05:11:56 2022 - graceful shutdown triggered... Aug 03 05:11:56.066991 dv-cinder-851279-4-iscsi devstack@n-api.service[103803]: Gracefully killing worker 1 (pid: 103803)... Aug 03 05:11:56.067421 dv-cinder-851279-4-iscsi devstack@n-api.service[103804]: Gracefully killing worker 2 (pid: 103804)... Aug 03 05:11:56.068881 dv-cinder-851279-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 03 05:11:57.067567 dv-cinder-851279-4-iscsi devstack@n-api.service[103802]: worker 1 buried after 1 seconds Aug 03 05:11:57.068188 dv-cinder-851279-4-iscsi devstack@n-api.service[103802]: worker 2 buried after 1 seconds Aug 03 05:11:57.068188 dv-cinder-851279-4-iscsi devstack@n-api.service[103802]: goodbye to uWSGI. Aug 03 05:11:57.069185 dv-cinder-851279-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 03 05:11:57.069757 dv-cinder-851279-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 03 05:11:57.072596 dv-cinder-851279-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 03 05:11:57.083886 dv-cinder-851279-4-iscsi devstack@n-api.service[118313]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 03 05:11:57.086269 dv-cinder-851279-4-iscsi devstack@n-api.service[118313]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 3 05:11:57 2022] *** Aug 03 05:11:57.086269 dv-cinder-851279-4-iscsi devstack@n-api.service[118313]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 03 05:11:57.086269 dv-cinder-851279-4-iscsi devstack@n-api.service[118313]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 03 05:11:57.086269 dv-cinder-851279-4-iscsi devstack@n-api.service[118313]: nodename: dv-cinder-851279-4-iscsi Aug 03 05:11:57.086269 dv-cinder-851279-4-iscsi devstack@n-api.service[118313]: machine: x86_64 Aug 03 05:11:57.086269 dv-cinder-851279-4-iscsi devstack@n-api.service[118313]: clock source: unix Aug 03 05:11:57.086269 dv-cinder-851279-4-iscsi devstack@n-api.service[118313]: pcre jit disabled Aug 03 05:11:57.086269 dv-cinder-851279-4-iscsi devstack@n-api.service[118313]: detected number of CPU cores: 4 Aug 03 05:11:57.086269 dv-cinder-851279-4-iscsi devstack@n-api.service[118313]: current working directory: / Aug 03 05:11:57.086269 dv-cinder-851279-4-iscsi devstack@n-api.service[118313]: detected binary path: /usr/bin/uwsgi-core Aug 03 05:11:57.086269 dv-cinder-851279-4-iscsi devstack@n-api.service[118313]: your processes number limit is 47680 Aug 03 05:11:57.086269 dv-cinder-851279-4-iscsi devstack@n-api.service[118313]: your memory page size is 4096 bytes Aug 03 05:11:57.086269 dv-cinder-851279-4-iscsi devstack@n-api.service[118313]: detected max file descriptor number: 2048 Aug 03 05:11:57.086269 dv-cinder-851279-4-iscsi devstack@n-api.service[118313]: lock engine: pthread robust mutexes Aug 03 05:11:57.088063 dv-cinder-851279-4-iscsi devstack@n-api.service[118313]: thunder lock: enabled Aug 03 05:11:57.088063 dv-cinder-851279-4-iscsi devstack@n-api.service[118313]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 03 05:11:57.088063 dv-cinder-851279-4-iscsi devstack@n-api.service[118313]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 03 05:11:57.129970 dv-cinder-851279-4-iscsi devstack@n-api.service[118313]: Python main interpreter initialized at 0x55e02afee9c0 Aug 03 05:11:57.129970 dv-cinder-851279-4-iscsi devstack@n-api.service[118313]: python threads support enabled Aug 03 05:11:57.129970 dv-cinder-851279-4-iscsi devstack@n-api.service[118313]: your server socket listen backlog is limited to 100 connections Aug 03 05:11:57.129970 dv-cinder-851279-4-iscsi devstack@n-api.service[118313]: your mercy for graceful operations on workers is 90 seconds Aug 03 05:11:57.130452 dv-cinder-851279-4-iscsi devstack@n-api.service[118313]: mapped 403077 bytes (393 KB) for 2 cores Aug 03 05:11:57.130452 dv-cinder-851279-4-iscsi devstack@n-api.service[118313]: *** Operational MODE: preforking *** Aug 03 05:11:57.130689 dv-cinder-851279-4-iscsi devstack@n-api.service[118313]: *** uWSGI is running in multiple interpreter mode *** Aug 03 05:11:57.130689 dv-cinder-851279-4-iscsi devstack@n-api.service[118313]: spawned uWSGI master process (pid: 118313) Aug 03 05:11:57.130914 dv-cinder-851279-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 03 05:11:57.131482 dv-cinder-851279-4-iscsi devstack@n-api.service[118313]: spawned uWSGI worker 1 (pid: 118331, cores: 1) Aug 03 05:11:57.132023 dv-cinder-851279-4-iscsi devstack@n-api.service[118313]: spawned uWSGI worker 2 (pid: 118332, cores: 1) Aug 03 05:11:57.132335 dv-cinder-851279-4-iscsi devstack@n-api.service[118313]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 03 05:11:57.809340 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 03 05:11:57.813452 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 03 05:11:58.980297 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 05:11:58.980297 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: from cryptography.utils import int_from_bytes Aug 03 05:11:58.980994 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 05:11:58.980994 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: from cryptography.utils import int_from_bytes Aug 03 05:11:58.982175 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 05:11:58.982175 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: from cryptography.utils import int_from_bytes Aug 03 05:11:58.982616 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 05:11:58.982616 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: from cryptography.utils import int_from_bytes Aug 03 05:12:01.412522 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 03 05:12:01.413213 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 03 05:12:01.413308 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 03 05:12:01.413308 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 03 05:12:01.413725 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 03 05:12:01.413812 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 03 05:12:01.413892 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 03 05:12:01.413892 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 03 05:12:01.414050 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 03 05:12:01.414407 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 03 05:12:01.414525 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.414612 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.414684 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.415492 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.415609 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.415823 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.415942 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.416139 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.416249 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.416476 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.416586 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.416800 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.416908 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.417123 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.417233 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.417447 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.417559 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.417725 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.417825 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.418033 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.418141 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.418350 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.418466 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851279-4-iscsi {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.418677 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.418785 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851279-4-iscsi {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.419027 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.419202 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.419477 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.419593 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.419795 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.419972 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.420125 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.420275 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.420426 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.420579 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.420731 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.420881 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.421032 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.421223 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.422788 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.423091 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.423381 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.423602 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.423827 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.424051 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.424281 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.424507 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.424742 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.424962 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.425172 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.425410 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.425640 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.425854 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.426074 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.426295 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.426518 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.426746 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.426974 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.427198 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.427416 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.427661 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851279-4-iscsi {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.427890 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851279-4-iscsi {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.428103 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.428291 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.428483 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.428667 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.428829 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.429047 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.429202 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.429362 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.429538 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.429696 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.429902 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.431185 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.431358 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.431514 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.431661 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.431813 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.431972 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.432126 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.432455 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.432610 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.432755 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.432986 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.433146 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.433314 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.433471 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.433623 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.433812 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.434005 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.434159 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.434311 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.434473 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.434625 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.434775 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.434985 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.435133 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.435289 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.435452 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.435603 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.435603 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.435896 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.436048 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.436199 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.436344 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.437062 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.437231 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.437376 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.437500 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.437626 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.437752 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.437867 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.438233 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.438369 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.438500 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.438616 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.438729 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.438874 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.445127 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.445289 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.445439 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.445621 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.445778 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.445921 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.446064 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.446262 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.446402 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.446541 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.446689 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.446830 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.446995 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.447135 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.447267 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.447399 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.447548 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.447688 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.447820 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.447951 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.448082 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.448220 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.448363 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.448503 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.448647 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.448785 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.448925 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.449068 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.449212 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.449345 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.449484 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.449627 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.449768 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.449915 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.450050 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.450181 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.450397 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.451021 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.451163 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.451340 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.451501 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.451670 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.451812 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.451945 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.452081 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.452222 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.452363 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.452503 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.452645 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.452785 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.452918 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.453063 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.453203 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.453355 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.453562 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.453705 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.453847 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.453980 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.454117 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.454259 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.454401 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.454533 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.454681 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.454822 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.454984 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.455123 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.455256 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.455386 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.455535 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.455668 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.455800 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.455931 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.456068 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.456208 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.456350 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.456492 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.456625 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.456755 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.456886 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.457025 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.457217 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.457366 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.457499 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.457629 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.457760 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.457899 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.458040 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.458183 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.458326 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.458459 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.458590 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.458729 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.458884 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.459033 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.459166 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.459297 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.459436 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.459580 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.459713 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.459862 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.460002 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.460134 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.460273 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.460448 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.460581 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.461161 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.461308 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.461441 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.461582 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.461729 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.461869 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.462009 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.462141 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.462279 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.462419 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.462567 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.462700 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.462860 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.463010 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.463152 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.463338 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.463477 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.463695 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.463831 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.463972 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.464114 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.464256 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.464400 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.464534 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.464678 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.464819 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.464952 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.465094 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.465227 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.465360 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.465523 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.465677 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.465819 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.465962 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.466102 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.466235 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.466374 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.466507 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.466717 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.466880 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.467028 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.467161 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.467301 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.467434 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.467579 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.467721 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.467863 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.468007 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.468139 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.468271 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.468415 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 05:12:01.468549 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.468670 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.468802 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.468916 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.469028 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.469028 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.469260 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.469260 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.469495 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.469613 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.469740 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.469740 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.469951 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.470071 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.470183 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.470333 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.470481 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.470598 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.470709 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.471346 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.471478 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.471594 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.473988 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.474126 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.474269 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.474445 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.474586 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.474732 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.474946 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.475128 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.475289 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.475423 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.475555 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.475687 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.475818 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.475964 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.476104 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.476245 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.476385 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.476524 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.476672 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.476812 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.476951 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.477091 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.477236 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.477880 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.478015 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.478128 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.478247 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.478368 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.478489 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.478610 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.478736 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.478877 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.479008 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.479132 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.479255 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.479370 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.479491 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.479612 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.479733 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.479845 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.479964 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.480086 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.480209 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.480322 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.480483 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.480611 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.480743 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.480885 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.481049 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.481704 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.482472 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.482625 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.482762 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.482962 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.483097 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.483230 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.483369 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.483511 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.483649 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.483807 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.484013 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.484155 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.484288 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.484427 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.484570 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.484716 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.485777 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.485930 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.486075 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.486211 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.486354 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.486480 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.486619 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.486762 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.486905 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.487030 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.487157 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.487271 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.487383 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.487495 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.487607 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.487736 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.487859 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.487973 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.488093 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.488215 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.488329 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.488441 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.488561 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.488674 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.488795 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.488909 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.489020 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.489141 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.489141 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.489352 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.489464 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.489581 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.489694 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.489819 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.489944 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.490078 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.490210 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.490341 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.490479 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.490625 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.490758 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.490905 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.491041 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.491162 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.491300 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.491968 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.492100 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.492228 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.492352 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.492473 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.492609 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.492724 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.492845 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.492960 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.493669 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.496336 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.496488 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.496610 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.496744 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.496887 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.497098 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.497240 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.497391 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.497526 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.497670 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.497810 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.497949 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.498212 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.498353 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.498486 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.498618 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.498758 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.498944 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.499093 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.499229 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.499349 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.499467 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.499586 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.499705 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.499832 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.499946 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.500073 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.500187 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.500308 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.500428 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.500554 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.500675 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.500788 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.500899 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.501063 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.501232 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.501421 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.501947 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.502291 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.502448 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.502602 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.502759 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.502929 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.503089 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.503235 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.503388 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.504093 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.504283 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.504440 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.504596 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.504750 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.504903 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.505049 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.505206 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.505351 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.505504 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.505656 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.505810 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.505962 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.506126 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.506413 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.506575 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.506728 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.506950 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.507114 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.507262 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.507406 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.507561 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.507706 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.507893 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.508064 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.508218 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.508371 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.508535 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.508714 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.508860 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.509016 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.509173 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.509317 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.509461 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.509610 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.509756 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.509926 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.510072 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.510223 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.510375 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.510537 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.510697 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.510861 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.511025 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.511171 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.511322 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.511488 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.511643 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.512126 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.512491 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.512652 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.512800 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.512953 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.513124 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.513278 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.513431 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.513576 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.513727 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.513879 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.514036 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.514188 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.514341 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.514341 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.514735 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.514903 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.519930 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.520103 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.520260 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.520406 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.520551 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.520705 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.520858 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.521003 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.521153 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.521298 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.521442 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.521601 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.521746 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.521929 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.522421 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.522810 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.522995 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.523156 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.523310 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.523463 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.523610 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.523754 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.523897 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.524051 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.524712 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.524864 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.525020 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.525164 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.525318 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.525472 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.525625 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.525770 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.525953 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.526120 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.526280 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.526434 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.526685 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.526872 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.527026 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.527188 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.527347 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.527496 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.527496 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.527778 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.527926 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.528078 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.528231 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.528376 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.528527 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.528679 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.528824 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.528984 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.529141 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.529286 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.529437 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.529581 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.529733 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.529892 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.530045 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.530189 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.530333 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.530483 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.530635 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.530793 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.530982 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.531136 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.531281 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.531476 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.531630 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.531796 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.531950 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.532121 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.532553 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.532886 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.533050 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.533197 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.533341 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.533497 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.533648 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.533793 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.533951 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.534097 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.534249 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.534393 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.534545 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.534696 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.534965 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.535127 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.535273 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.535425 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.535581 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.535726 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.535885 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.536049 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.536201 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.536346 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.536489 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.536664 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.536896 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.537048 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.537192 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.537336 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.537485 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.537700 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.537849 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.537994 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.538709 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.538902 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.539059 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.539225 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.539381 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.539525 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.539670 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.539776 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.540022 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.540707 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.540864 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.541017 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.541171 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.541315 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.541458 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.541610 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.541762 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.541913 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.542076 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.542231 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.542698 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.543082 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.543254 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.543409 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.543554 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.543698 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.543857 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.544002 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.544002 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.544284 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.544430 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.544573 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.544726 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.544870 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.545014 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.545166 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.545166 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.545458 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.545604 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.545757 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.545901 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.546058 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.546208 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.546368 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.546523 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.546646 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.546773 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.551896 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.552056 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.552212 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.552359 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.552502 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.552956 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.553336 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.553491 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.553647 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.553805 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.553959 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.554104 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.554248 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.554413 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.554413 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.554711 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.554889 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.555053 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.555198 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.555342 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.555530 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.555686 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.555841 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.555987 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.556139 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.556327 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.556500 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.556654 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.556807 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.556807 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.557187 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.557340 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.557494 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.557648 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.557793 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.557946 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.558098 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.558243 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.558401 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.558558 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.558718 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.558949 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.559133 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.559292 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.559445 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.559590 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.559743 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.559895 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.560047 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.560203 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.560348 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.560510 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.560656 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.560811 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.560958 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.561117 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.561262 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.561413 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.561558 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.561702 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.561853 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.562021 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.562170 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.562314 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.562468 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.562620 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.562793 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.563259 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.563259 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.563729 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.563883 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.564028 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.564222 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.564371 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.564515 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.564659 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.564802 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.564958 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.565124 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.565270 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.565421 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.565565 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.565716 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.565860 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.566016 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.566161 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.566305 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.566482 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.566664 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.566831 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.567082 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.567333 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.567495 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.567647 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.567794 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.567947 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.568099 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.568244 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.568388 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.568539 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.568683 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.568839 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.568992 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.569154 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.569308 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.569461 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.569607 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.569763 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.569916 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.570067 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.570067 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.570352 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.570515 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.570670 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.570828 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.570828 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.571195 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.571386 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.571611 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.571759 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.571954 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.572111 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.572256 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.572444 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.572606 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.573889 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.574053 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.574202 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.574371 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.574525 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.574680 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.574828 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.575012 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.575160 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.575313 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.575473 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.575626 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.575779 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.575925 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.576069 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.576213 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.576376 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.576523 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.576674 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.576828 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.576981 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.577127 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.577298 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.577521 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.577671 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.577825 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.577972 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.578124 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.578279 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.578434 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.578579 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.578723 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.578910 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.578910 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.579214 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.579367 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.579512 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.579656 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.579799 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.580021 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.580170 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.580315 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.580469 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.580622 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.580787 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.580944 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.581096 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.581241 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.581241 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.581522 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.581720 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.581928 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.582088 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.582242 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.582399 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.582544 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.582697 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.582863 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.583015 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.583468 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.583625 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.583797 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.584129 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.584289 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.584448 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.584601 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.584751 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.584914 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.585075 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.585228 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.585386 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.585538 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.585689 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.585839 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.586003 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.586164 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.586323 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.586482 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.586641 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.587385 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.587665 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.587829 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.587989 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.588155 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.588308 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.588470 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.588632 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.588797 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.588950 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.589102 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.589251 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.589416 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.589582 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.589745 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.589897 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.590047 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.590205 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.590205 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.590505 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.590655 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.590805 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.590982 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.591154 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.591916 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.592095 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.592265 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.592418 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.592571 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.592722 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.592881 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.593040 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.593205 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.593660 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.593822 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.593937 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.594082 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.594409 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.594526 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.594641 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.594641 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.600318 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.600497 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.600649 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.600789 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.600934 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.601069 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.601202 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.601348 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.601603 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.601744 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.601878 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.602021 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.602163 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.602572 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.603262 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.603409 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.603910 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.604059 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.604196 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.604361 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.604718 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.604853 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.604985 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.605128 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.605507 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.605657 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.605866 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.606010 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.606155 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.606155 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.606443 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.606747 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.606923 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.607071 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.607212 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.607345 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.607454 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.607557 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.607653 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.607762 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.607850 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.607931 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.608027 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.608116 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.608116 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.608280 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.608367 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.608452 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.608552 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.608641 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.608734 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.608821 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.608914 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.609011 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.609106 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.609193 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.609285 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.609285 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.609442 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.609534 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.609630 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.609725 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.609813 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.609898 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.609983 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.610078 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.610165 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.610251 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.610480 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.610577 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.610673 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.610769 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.610887 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.610976 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.611063 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.611160 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.611254 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.611350 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.611446 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.611607 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.611713 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.611809 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.612008 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.612107 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.612195 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.612288 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.612375 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.612471 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.612566 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.612653 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.612752 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.612838 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.612930 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.613026 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.613123 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.613218 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.613313 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.613400 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.613499 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.613586 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.613586 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.614054 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.614155 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.614242 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.614343 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.614440 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.614546 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.614702 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.614990 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.615086 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.615187 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.615187 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.615363 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.615450 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.615543 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.615639 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.615736 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.615830 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.615918 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.616010 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.616098 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.616196 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.616284 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.616369 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.616467 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.616555 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.616641 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.616740 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.616839 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.616930 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.617017 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.617103 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.617188 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.617282 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.617370 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.617463 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.617635 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.617769 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.617938 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.618061 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.618147 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.618241 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.618336 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.618431 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.618518 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.618616 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.618710 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.618797 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.618916 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.619059 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.619170 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.619267 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.619267 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.619424 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.619509 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.619595 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.619690 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.619779 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.619871 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.619871 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.620037 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.620129 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.620224 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.620310 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.620396 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.620497 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.620585 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.620684 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.620772 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.620857 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.620943 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.621016 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.621100 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.621194 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.621288 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.621374 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.621459 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.621544 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.621637 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.621732 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.621826 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.621913 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.621999 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.622084 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.622176 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.622276 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.622370 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.622464 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.622464 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.622633 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.622733 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.622821 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.622921 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.623008 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.623082 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.623153 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.623257 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.623346 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.623431 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.623524 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.623611 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.623703 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.623798 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.623907 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.624210 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.624316 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.624412 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.624500 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.624596 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.624703 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.624835 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.624968 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.625190 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.625328 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.625451 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.625573 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.625697 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.625798 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.625897 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.625994 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.626082 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.626082 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.626239 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.626324 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.626423 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.626528 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.626617 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.626702 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.626788 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.629005 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.629177 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.629337 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.629337 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.629337 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.629589 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.629682 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.629842 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.629938 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.630032 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.630126 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.630126 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.630293 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.630387 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.630469 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.630550 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.630624 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.630695 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.630766 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.630869 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.630962 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.631044 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.631044 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.631190 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.631271 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.631359 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.631440 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.631440 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.631588 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.631668 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.631751 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.631832 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.631832 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.631970 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.632043 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.632115 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.632196 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.632277 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.632357 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.632432 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.632504 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.632504 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.632504 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.632504 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.632765 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.632848 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.632921 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.633005 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.633088 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.633169 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.633244 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.633323 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.633402 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.633484 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.633581 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.633667 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.633749 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.633823 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.633902 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.633985 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.634066 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.634161 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.634424 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.634535 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.634622 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.634698 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.634779 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.634890 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.634982 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.636414 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.636414 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.636582 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.636657 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.636739 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.636813 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.636813 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.636965 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.637041 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.637041 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.637171 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.637242 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.637323 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.637406 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.637487 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.637567 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.637647 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.637647 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.637796 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.637878 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.637958 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.638037 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.638111 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.638111 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.638251 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.638323 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.638395 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.638481 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.638557 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.638642 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.638642 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.642309 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.642438 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.642556 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.642674 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.642804 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.643038 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.643164 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.643280 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.643400 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.643523 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.643650 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.643773 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.643887 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.644001 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.644113 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.644242 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.644579 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.644705 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.644809 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.644898 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.644985 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.645080 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.645218 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.645333 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.645455 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.645557 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.645653 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.645753 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.645847 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.645934 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.646021 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.646124 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.646255 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.646412 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.646651 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.646778 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.646891 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.646981 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.647083 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.647173 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.647173 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.647330 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.647415 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.647500 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.647594 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.647689 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.647783 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.647876 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.647876 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.648042 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.648137 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.648231 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.648325 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.648423 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.648510 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.648617 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.648714 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.648800 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.648800 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.648944 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.649036 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.649036 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.649734 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.649823 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.649951 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.650046 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.650140 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.650242 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.650337 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.650425 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.650510 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.650596 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.650682 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.650779 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.650974 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.651067 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.651151 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.651238 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.651322 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.651416 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.651511 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.651604 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.651700 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.651788 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.651888 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.651972 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.652054 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.652135 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.652209 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.652209 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.652428 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.652519 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.652612 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.652699 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.652784 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.652876 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.652975 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.653062 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.653154 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.653241 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.653241 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.653410 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.653510 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.653510 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.653674 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.653759 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.653839 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.653937 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.653937 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.654101 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.654195 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.654269 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.654364 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.654483 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.654705 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.654807 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.662688 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.662877 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.662877 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.662877 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.663236 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.663351 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.663474 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.663474 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.663706 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.663823 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.663936 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.664057 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.664171 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.664292 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.664292 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.664520 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.664520 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.665990 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.666082 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.666082 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.666234 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.666315 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.666315 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.666454 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.666533 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.666533 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.666694 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.666804 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.666804 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.667173 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.667273 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.667273 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.667446 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.667534 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.667534 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.667534 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.667793 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.667881 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.667968 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.668053 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.668053 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.668053 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.668053 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.668375 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.668470 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.668470 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.668626 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.668758 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.668758 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.668941 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.669023 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.669023 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.669188 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.669287 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.669287 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.669287 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.669531 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.669531 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.669694 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.669694 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.669863 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.670020 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.670020 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.670228 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.670323 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.670323 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.670538 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.670669 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.670669 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.670669 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.670951 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.671041 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.671041 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.671206 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.671291 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.671377 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.671476 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.671476 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.671634 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.671727 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.671727 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.671899 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.671999 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.671999 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.672176 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.672263 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.672263 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.672435 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.672523 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.672523 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.672686 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.672773 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.672773 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.672950 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.673050 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.673050 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.673215 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.673310 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.673310 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.673483 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.673577 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.673671 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.673671 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.673836 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.673836 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.674009 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.674106 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.674194 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.674279 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.674279 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.674460 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.674547 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.674633 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.674718 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.674811 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.674973 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.675084 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.675223 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.675322 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.675409 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.675495 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.675580 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.675693 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.675921 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.676000 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.676082 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.676163 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.676255 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.676338 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.676412 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.676492 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.676567 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.676646 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.676727 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.676808 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.676898 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.676898 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.677076 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.677161 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.677249 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.677337 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.677429 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.677516 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.677608 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.677701 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.677802 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.677896 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.677984 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.678076 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.678170 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.678269 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.678365 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.678451 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.678451 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.678606 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.678691 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.678989 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.679095 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.679192 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.679287 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.679385 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.679481 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.679583 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.679683 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.679778 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.679873 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.679968 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.680052 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.680140 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.680274 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.680369 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.680484 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.680580 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.680676 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.680815 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.680918 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.681006 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.681100 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.681196 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.681296 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.681400 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.681496 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.681583 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.681670 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.681784 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.681872 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.681965 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.682052 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.682150 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.682237 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.682336 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.682431 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.682526 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.682630 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.682728 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.682728 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.682929 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.683018 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.683114 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.683208 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.683303 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.683390 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.683485 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.683580 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.683667 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.683761 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.683848 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.683948 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.684035 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.684128 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.684223 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.684318 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.684405 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.684504 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.684601 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.684688 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.684781 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.684875 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.684962 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.685100 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.685196 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 03 05:12:01.685295 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.685295 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.685295 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.685295 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.685295 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.685295 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.685295 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.685295 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.686088 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.686088 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.686088 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.686088 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.686088 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.686088 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.686088 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.686088 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.686810 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.686810 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.686810 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.686810 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.687142 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.687469 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.687894 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.688215 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.688547 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.688861 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.689173 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.689482 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.689793 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.690104 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.690420 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.690731 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.691230 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.691839 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.691965 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.692327 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.692595 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.692935 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.693494 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.693613 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.693939 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.694299 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.694647 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.695002 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.695321 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.695683 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.696051 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 05:12:01.696213 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 03 05:12:01.742465 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO dbcounter [None req-90ba8dc6-7f4e-4f6f-ba68-a1ecb997231b None None] Registered counter for database nova_api Aug 03 05:12:01.761864 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO dbcounter [None req-59242b7b-d019-48c4-b727-57030095253a None None] Registered counter for database nova_api Aug 03 05:12:01.763011 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_db.sqlalchemy.engines [None req-90ba8dc6-7f4e-4f6f-ba68-a1ecb997231b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118332) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 05:12:01.769797 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writer thread running {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 05:12:01.780236 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_db.sqlalchemy.engines [None req-59242b7b-d019-48c4-b727-57030095253a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118331) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 05:12:01.787152 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writer thread running {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 05:12:01.825363 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.context [None req-90ba8dc6-7f4e-4f6f-ba68-a1ecb997231b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e4c70b33-dcef-4553-8910-fe7fe241a76c(cell1) {{(pid=118332) load_cells /opt/stack/nova/nova/context.py:464}} Aug 03 05:12:01.829500 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-90ba8dc6-7f4e-4f6f-ba68-a1ecb997231b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:01.831090 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-90ba8dc6-7f4e-4f6f-ba68-a1ecb997231b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:01.831889 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-90ba8dc6-7f4e-4f6f-ba68-a1ecb997231b None None] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:01.833875 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-90ba8dc6-7f4e-4f6f-ba68-a1ecb997231b None None] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:01.835891 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO dbcounter [None req-90ba8dc6-7f4e-4f6f-ba68-a1ecb997231b None None] Registered counter for database nova_cell0 Aug 03 05:12:01.840536 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO dbcounter [None req-90ba8dc6-7f4e-4f6f-ba68-a1ecb997231b None None] Registered counter for database nova_cell1 Aug 03 05:12:01.843478 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.context [None req-59242b7b-d019-48c4-b727-57030095253a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e4c70b33-dcef-4553-8910-fe7fe241a76c(cell1) {{(pid=118331) load_cells /opt/stack/nova/nova/context.py:464}} Aug 03 05:12:01.848772 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_db.sqlalchemy.engines [None req-90ba8dc6-7f4e-4f6f-ba68-a1ecb997231b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118332) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 05:12:01.848960 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-59242b7b-d019-48c4-b727-57030095253a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:01.849775 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_db.sqlalchemy.engines [None req-90ba8dc6-7f4e-4f6f-ba68-a1ecb997231b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118332) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 05:12:01.850142 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-59242b7b-d019-48c4-b727-57030095253a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:01.853548 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-59242b7b-d019-48c4-b727-57030095253a None None] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:01.853672 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-59242b7b-d019-48c4-b727-57030095253a None None] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:01.855682 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO dbcounter [None req-59242b7b-d019-48c4-b727-57030095253a None None] Registered counter for database nova_cell0 Aug 03 05:12:01.855786 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writer thread running {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 05:12:01.859803 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO dbcounter [None req-59242b7b-d019-48c4-b727-57030095253a None None] Registered counter for database nova_cell1 Aug 03 05:12:01.866665 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_db.sqlalchemy.engines [None req-59242b7b-d019-48c4-b727-57030095253a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118331) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 05:12:01.869893 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_db.sqlalchemy.engines [None req-59242b7b-d019-48c4-b727-57030095253a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118331) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 05:12:01.876627 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writer thread running {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 05:12:01.878090 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writer thread running {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 05:12:01.996137 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writer thread running {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 05:12:02.006403 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO dbcounter [None req-90ba8dc6-7f4e-4f6f-ba68-a1ecb997231b None None] Registered counter for database nova_cell0 Aug 03 05:12:02.012993 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_db.sqlalchemy.engines [None req-90ba8dc6-7f4e-4f6f-ba68-a1ecb997231b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118332) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 05:12:02.017481 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writer thread running {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 05:12:02.028970 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO dbcounter [None req-59242b7b-d019-48c4-b727-57030095253a None None] Registered counter for database nova_cell0 Aug 03 05:12:02.038376 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_db.sqlalchemy.engines [None req-59242b7b-d019-48c4-b727-57030095253a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118331) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 05:12:02.043479 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writer thread running {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 05:12:02.344497 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: WARNING keystonemiddleware.auth_token [None req-90ba8dc6-7f4e-4f6f-ba68-a1ecb997231b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 05:12:02.351749 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: WARNING keystonemiddleware.auth_token [None req-90ba8dc6-7f4e-4f6f-ba68-a1ecb997231b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 05:12:02.379575 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: WARNING keystonemiddleware.auth_token [None req-59242b7b-d019-48c4-b727-57030095253a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 05:12:02.386952 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: WARNING keystonemiddleware.auth_token [None req-59242b7b-d019-48c4-b727-57030095253a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 05:12:02.706154 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: WARNING keystonemiddleware.auth_token [None req-90ba8dc6-7f4e-4f6f-ba68-a1ecb997231b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 05:12:02.713017 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: WARNING keystonemiddleware.auth_token [None req-90ba8dc6-7f4e-4f6f-ba68-a1ecb997231b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 05:12:02.718527 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e02afee9c0 pid: 118332 (default app) Aug 03 05:12:02.741894 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: WARNING keystonemiddleware.auth_token [None req-59242b7b-d019-48c4-b727-57030095253a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 05:12:02.748009 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: WARNING keystonemiddleware.auth_token [None req-59242b7b-d019-48c4-b727-57030095253a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 05:12:02.759845 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e02afee9c0 pid: 118331 (default app) Aug 03 05:12:49.187056 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-c32c3d90-567b-43be-978d-3a6c37680c23 tempest-VolumesTestJSON-1334800346 tempest-VolumesTestJSON-1334800346-project] Calling method '.version_select at 0x7f7603fcf0d0>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:49.235546 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_api:SELECT=3 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:12:49.238519 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_cell0:SELECT=3 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:12:49.238519 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_cell1:SELECT=3 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:12:49.240813 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_cell0:SELECT=3 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:12:49.994474 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-c32c3d90-567b-43be-978d-3a6c37680c23 tempest-VolumesTestJSON-1334800346 tempest-VolumesTestJSON-1334800346-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/cbc86ed9-65ac-42f8-b3dc-d3fb54da9e5b" status: 200 len: 351 microversion: 2.1 time: 1.104786 Aug 03 05:12:49.996260 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 1/1] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Aug 3 05:12:48 2022] GET /compute/v2.1/os-volumes/cbc86ed9-65ac-42f8-b3dc-d3fb54da9e5b => generated 351 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:12:52.261674 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_api:SELECT=3 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:12:52.267282 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=3 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:12:52.269724 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell0:SELECT=3 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:12:52.275655 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell0:SELECT=3 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:12:52.385961 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-a14a8416-458d-4aab-9f66-9714e20d5c64 tempest-VolumesTestJSON-1334800346 tempest-VolumesTestJSON-1334800346-project] Calling method '.version_select at 0x7f7603d6c160>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:52.500255 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-a14a8416-458d-4aab-9f66-9714e20d5c64 tempest-VolumesTestJSON-1334800346 tempest-VolumesTestJSON-1334800346-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/dee2e8ff-a2f3-430e-8b55-e378055735c1" status: 200 len: 351 microversion: 2.1 time: 0.120070 Aug 03 05:12:52.501361 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 2/2] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Aug 3 05:12:52 2022] GET /compute/v2.1/os-volumes/dee2e8ff-a2f3-430e-8b55-e378055735c1 => generated 351 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:12:52.914217 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-4f984e11-3082-4086-a2eb-89e4de14ebcc tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1675500798", "imageRef": "37d7ad4a-d925-48e6-84af-ec878f19050e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:12:53.858103 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.network.neutron [None req-4f984e11-3082-4086-a2eb-89e4de14ebcc tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] validate_networks() for [('2e69d8c5-66e7-4f9d-9779-ca17893c6637', None, None, None, None, None)] {{(pid=118331) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:12:54.768287 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-ff9b4237-3610-4f56-a5d7-5d1d2acc6a1b tempest-VolumesTestJSON-1334800346 tempest-VolumesTestJSON-1334800346-project] Calling method '.version_select at 0x7f7603d6c280>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:54.868651 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-ff9b4237-3610-4f56-a5d7-5d1d2acc6a1b tempest-VolumesTestJSON-1334800346 tempest-VolumesTestJSON-1334800346-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/f3bcf71e-89e7-42a7-8ca6-25a4493b8671" status: 200 len: 350 microversion: 2.1 time: 0.105190 Aug 03 05:12:54.869455 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 3/3] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Aug 3 05:12:54 2022] GET /compute/v2.1/os-volumes/f3bcf71e-89e7-42a7-8ca6-25a4493b8671 => generated 350 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:12:54.882989 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-e1ccd7cd-4ef2-4e3d-9024-9d2c7fe55d58 tempest-VolumesTestJSON-1334800346 tempest-VolumesTestJSON-1334800346-project] Calling method '.version_select at 0x7f7603d6c820>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:55.136961 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-e1ccd7cd-4ef2-4e3d-9024-9d2c7fe55d58 tempest-VolumesTestJSON-1334800346 tempest-VolumesTestJSON-1334800346-project] 10.222.0.40 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.257871 Aug 03 05:12:55.138092 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 4/4] 10.222.0.40 () {58 vars in 1134 bytes} [Wed Aug 3 05:12:54 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:12:55.153658 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-61be3264-3070-40fc-bdb5-18335c9bdf90 tempest-VolumesTestJSON-1334800346 tempest-VolumesTestJSON-1334800346-project] Calling method '.version_select at 0x7f7603d6ce50>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:55.370138 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-61be3264-3070-40fc-bdb5-18335c9bdf90 tempest-VolumesTestJSON-1334800346 tempest-VolumesTestJSON-1334800346-project] 10.222.0.40 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.220954 Aug 03 05:12:55.380961 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 5/5] 10.222.0.40 () {58 vars in 1149 bytes} [Wed Aug 3 05:12:55 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:12:55.386670 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-8facd1d1-0f4b-4d9c-91b6-fbb8c7c71f33 tempest-VolumesTestJSON-1334800346 tempest-VolumesTestJSON-1334800346-project] Calling method '.version_select at 0x7f7603d86550>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:55.548352 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-8facd1d1-0f4b-4d9c-91b6-fbb8c7c71f33 tempest-VolumesTestJSON-1334800346 tempest-VolumesTestJSON-1334800346-project] 10.222.0.40 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.164675 Aug 03 05:12:55.563433 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 6/6] 10.222.0.40 () {58 vars in 1134 bytes} [Wed Aug 3 05:12:55 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:12:55.566693 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-9b8d3e64-e9f2-4547-b877-1809139fc57e tempest-VolumesTestJSON-1334800346 tempest-VolumesTestJSON-1334800346-project] Calling method '.version_select at 0x7f7603d86940>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:55.716774 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-9b8d3e64-e9f2-4547-b877-1809139fc57e tempest-VolumesTestJSON-1334800346 tempest-VolumesTestJSON-1334800346-project] 10.222.0.40 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.156091 Aug 03 05:12:55.717436 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 7/7] 10.222.0.40 () {58 vars in 1167 bytes} [Wed Aug 3 05:12:55 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:12:55.733517 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-844f03fe-c35e-4827-863f-ee5af242cffe tempest-VolumesTestJSON-1334800346 tempest-VolumesTestJSON-1334800346-project] Calling method '.version_select at 0x7f7603d6c940>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:55.870210 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-844f03fe-c35e-4827-863f-ee5af242cffe tempest-VolumesTestJSON-1334800346 tempest-VolumesTestJSON-1334800346-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.140918 Aug 03 05:12:55.883949 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 8/8] 10.222.0.40 () {58 vars in 1170 bytes} [Wed Aug 3 05:12:55 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:12:55.889663 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-26561aae-401d-4a6e-9f24-6ecd62db0d2d tempest-VolumesTestJSON-1334800346 tempest-VolumesTestJSON-1334800346-project] Calling method '.version_select at 0x7f7603d894c0>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:56.046729 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-26561aae-401d-4a6e-9f24-6ecd62db0d2d tempest-VolumesTestJSON-1334800346 tempest-VolumesTestJSON-1334800346-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.160755 Aug 03 05:12:56.047380 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 9/9] 10.222.0.40 () {58 vars in 1155 bytes} [Wed Aug 3 05:12:55 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:12:56.066364 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-09e7156c-f2bf-4898-92c9-f458ef8f0f11 tempest-VolumesTestJSON-1334800346 tempest-VolumesTestJSON-1334800346-project] Calling method '.version_select at 0x7f7603d86430>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:56.201241 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-09e7156c-f2bf-4898-92c9-f458ef8f0f11 tempest-VolumesTestJSON-1334800346 tempest-VolumesTestJSON-1334800346-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.139581 Aug 03 05:12:56.213637 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 10/10] 10.222.0.40 () {58 vars in 1188 bytes} [Wed Aug 3 05:12:56 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:12:56.219081 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-72f8995b-bd4d-4216-888f-c2e5b789d777 tempest-VolumesTestJSON-1334800346 tempest-VolumesTestJSON-1334800346-project] Calling method '.version_select at 0x7f7603d6c040>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:56.392782 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-72f8995b-bd4d-4216-888f-c2e5b789d777 tempest-VolumesTestJSON-1334800346 tempest-VolumesTestJSON-1334800346-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.177238 Aug 03 05:12:56.393413 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 11/11] 10.222.0.40 () {58 vars in 1155 bytes} [Wed Aug 3 05:12:56 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:12:57.483962 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-4f984e11-3082-4086-a2eb-89e4de14ebcc tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Flavor limits 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:12:57.484576 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-4f984e11-3082-4086-a2eb-89e4de14ebcc tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Image limits 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:12:57.485171 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-4f984e11-3082-4086-a2eb-89e4de14ebcc tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Flavor pref 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:12:57.485796 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-4f984e11-3082-4086-a2eb-89e4de14ebcc tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Image pref 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:12:57.486019 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-4f984e11-3082-4086-a2eb-89e4de14ebcc tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:12:57.513761 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4f984e11-3082-4086-a2eb-89e4de14ebcc tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:57.523895 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4f984e11-3082-4086-a2eb-89e4de14ebcc tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:57.534653 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4f984e11-3082-4086-a2eb-89e4de14ebcc tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:57.535372 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4f984e11-3082-4086-a2eb-89e4de14ebcc tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:57.605344 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-4f984e11-3082-4086-a2eb-89e4de14ebcc tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Getting quotas for project 829c8e80e96d40d682a17185eb4da336. Resources: {'instances', 'ram', 'cores'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:12:57.613260 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-4f984e11-3082-4086-a2eb-89e4de14ebcc tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Getting quotas for user bb0fe4cb98e0447cad3e126da1a8de9c and project 829c8e80e96d40d682a17185eb4da336. Resources: {'instances', 'ram', 'cores'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:12:57.633455 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-4f984e11-3082-4086-a2eb-89e4de14ebcc tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Going to run 1 instances... {{(pid=118331) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:12:57.638014 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-4f984e11-3082-4086-a2eb-89e4de14ebcc tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 7ee7115a-8a61-415c-a4ba-b53c2aa0c442] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37d7ad4a-d925-48e6-84af-ec878f19050e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:12:57.954131 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-4f984e11-3082-4086-a2eb-89e4de14ebcc tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.725845 Aug 03 05:12:57.955441 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 1/12] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Aug 3 05:12:52 2022] POST /compute/v2.1/servers => generated 383 bytes in 5729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 05:12:57.967161 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-d8f7a446-3599-4120-a46f-db6e9639ebd5 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:57.967929 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-d8f7a446-3599-4120-a46f-db6e9639ebd5 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 7ee7115a-8a61-415c-a4ba-b53c2aa0c442] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:58.306119 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-d8f7a446-3599-4120-a46f-db6e9639ebd5 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:12:58.331697 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-d8f7a446-3599-4120-a46f-db6e9639ebd5 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442" status: 200 len: 1222 microversion: 2.1 time: 0.368342 Aug 03 05:12:58.332262 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 12/13] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:12:57 2022] GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442 => generated 1222 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:12:59.079635 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-60df59d4-fb00-4451-a7e3-b577d13bdf07 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1676967462", "imageRef": "37d7ad4a-d925-48e6-84af-ec878f19050e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:12:59.214063 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.network.neutron [None req-60df59d4-fb00-4451-a7e3-b577d13bdf07 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] validate_networks() for [('2e69d8c5-66e7-4f9d-9779-ca17893c6637', None, None, None, None, None)] {{(pid=118331) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:12:59.799082 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-8caff01e-0b0e-416b-9d6b-d60780d4af5a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Action: 'create', calling method: .version_select at 0x7f7603d6cca0>, body: {"keypair": {"name": "tempest-keypair-569832163", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCxJ673U46mZi3ETTlwkaeRrLnSiQd8kLpzT7S7IObedi9JfYPs0/EbYWoX3GN7JeX9rUgpCjKdouSuhMvcqvgmV3bBr2EknZGdCHQK2OWEcwk2+oHkxd6mDebH1t3YQGw=="}} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:13:00.006311 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.quota [None req-8caff01e-0b0e-416b-9d6b-d60780d4af5a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Getting quotas for project 050592077e0b4d26a1555d2daa7f460d. Resources: {'key_pairs'} {{(pid=118332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:13:00.029247 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.quota [None req-8caff01e-0b0e-416b-9d6b-d60780d4af5a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Getting quotas for user 747a608061504d7693f0f99ecdfa476e and project 050592077e0b4d26a1555d2daa7f460d. Resources: {'key_pairs'} {{(pid=118332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:13:00.289342 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-8caff01e-0b0e-416b-9d6b-d60780d4af5a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.902196 Aug 03 05:13:00.295457 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 13/14] 10.222.0.40 () {62 vars in 1200 bytes} [Wed Aug 3 05:12:59 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 904 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 03 05:13:01.144228 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-60df59d4-fb00-4451-a7e3-b577d13bdf07 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Flavor limits 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:13:01.144739 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-60df59d4-fb00-4451-a7e3-b577d13bdf07 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Image limits 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:13:01.145209 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-60df59d4-fb00-4451-a7e3-b577d13bdf07 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Flavor pref 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:13:01.146277 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-60df59d4-fb00-4451-a7e3-b577d13bdf07 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Image pref 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:13:01.146718 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-60df59d4-fb00-4451-a7e3-b577d13bdf07 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:13:01.164072 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-60df59d4-fb00-4451-a7e3-b577d13bdf07 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:01.164540 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-60df59d4-fb00-4451-a7e3-b577d13bdf07 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:01.171354 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-60df59d4-fb00-4451-a7e3-b577d13bdf07 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:01.172068 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-60df59d4-fb00-4451-a7e3-b577d13bdf07 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:01.259031 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-60df59d4-fb00-4451-a7e3-b577d13bdf07 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Getting quotas for project 829c8e80e96d40d682a17185eb4da336. Resources: {'instances', 'ram', 'cores'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:13:01.279383 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-60df59d4-fb00-4451-a7e3-b577d13bdf07 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Getting quotas for user bb0fe4cb98e0447cad3e126da1a8de9c and project 829c8e80e96d40d682a17185eb4da336. Resources: {'instances', 'ram', 'cores'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:13:01.315144 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-60df59d4-fb00-4451-a7e3-b577d13bdf07 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Going to run 1 instances... {{(pid=118331) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:13:01.319992 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-60df59d4-fb00-4451-a7e3-b577d13bdf07 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37d7ad4a-d925-48e6-84af-ec878f19050e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:13:01.619663 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-60df59d4-fb00-4451-a7e3-b577d13bdf07 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.545610 Aug 03 05:13:01.624458 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 2/15] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Aug 3 05:12:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 2552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 05:13:01.639376 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-1c129a59-ec7c-4d62-9cc5-6ce79cfdc3e2 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:01.639376 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-1c129a59-ec7c-4d62-9cc5-6ce79cfdc3e2 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:01.934664 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-1c129a59-ec7c-4d62-9cc5-6ce79cfdc3e2 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:01.963492 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-1c129a59-ec7c-4d62-9cc5-6ce79cfdc3e2 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c" status: 200 len: 1222 microversion: 2.1 time: 0.316290 Aug 03 05:13:01.963492 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 14/16] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:01 2022] GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c => generated 1222 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:02.978476 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-81d6a29c-ca9e-4dc8-9f10-0a98109e8880 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:02.979138 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-81d6a29c-ca9e-4dc8-9f10-0a98109e8880 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:03.280839 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-81d6a29c-ca9e-4dc8-9f10-0a98109e8880 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:03.334498 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-81d6a29c-ca9e-4dc8-9f10-0a98109e8880 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c" status: 200 len: 1222 microversion: 2.1 time: 0.360644 Aug 03 05:13:03.337512 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 3/17] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:02 2022] GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c => generated 1222 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:04.362205 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-4b3dc503-fb62-4512-852a-e45f11a652f4 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:04.363244 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-4b3dc503-fb62-4512-852a-e45f11a652f4 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:04.386259 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4b3dc503-fb62-4512-852a-e45f11a652f4 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:04.386259 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4b3dc503-fb62-4512-852a-e45f11a652f4 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:04.390599 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4b3dc503-fb62-4512-852a-e45f11a652f4 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:04.391223 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4b3dc503-fb62-4512-852a-e45f11a652f4 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:04.618858 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-50e98302-ae9c-49ea-a419-8a3eeb656f20 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Action: 'create', calling method: .version_select at 0x7f7603cddb80>, body: {"keypair": {"name": "tempest-keypair-575887889", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHYwkTiF89HkhYlVMfJ5MkvI36mvZBBwK9q4M7LeDFhQ9+U6CATvADGFi8/Dz7ZkuzQeJH61CCf1LshpioT0s21oklsdiK4dMAn1QV6asDBUUlcHbuoQnB0/MbRgWwBu1A=="}} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:13:04.721472 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.quota [None req-50e98302-ae9c-49ea-a419-8a3eeb656f20 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Getting quotas for project 2e1ed25abd8e43009dd8f3f4b7ec1864. Resources: {'key_pairs'} {{(pid=118332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:13:04.732579 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.quota [None req-50e98302-ae9c-49ea-a419-8a3eeb656f20 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Getting quotas for user f01737ba3200470c8635f335d0338ac8 and project 2e1ed25abd8e43009dd8f3f4b7ec1864. Resources: {'key_pairs'} {{(pid=118332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:13:04.884881 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-50e98302-ae9c-49ea-a419-8a3eeb656f20 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.048377 Aug 03 05:13:04.885607 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 15/18] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Aug 3 05:13:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:13:05.031597 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-4b3dc503-fb62-4512-852a-e45f11a652f4 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:05.095204 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-4b3dc503-fb62-4512-852a-e45f11a652f4 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c" status: 200 len: 1226 microversion: 2.1 time: 0.737644 Aug 03 05:13:05.097661 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 4/19] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:04 2022] GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c => generated 1226 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:06.120911 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-3c470cad-c17c-4529-88d2-4200e0a06bc3 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:06.122503 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-3c470cad-c17c-4529-88d2-4200e0a06bc3 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:06.140515 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3c470cad-c17c-4529-88d2-4200e0a06bc3 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:06.142456 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3c470cad-c17c-4529-88d2-4200e0a06bc3 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:06.145783 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3c470cad-c17c-4529-88d2-4200e0a06bc3 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:06.150775 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3c470cad-c17c-4529-88d2-4200e0a06bc3 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:06.553375 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-3c470cad-c17c-4529-88d2-4200e0a06bc3 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:06.558785 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-da94b14c-e97b-47e4-9ef1-421e6f7cde93 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-487214109", "imageRef": "37d7ad4a-d925-48e6-84af-ec878f19050e", "flavorRef": "452", "networks": [{"uuid": "5332b22b-0717-4e00-8913-c8b77d2d5704"}]}} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:13:06.587791 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-3c470cad-c17c-4529-88d2-4200e0a06bc3 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c" status: 200 len: 1274 microversion: 2.1 time: 0.458063 Aug 03 05:13:06.587791 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 5/20] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:06 2022] GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c => generated 1274 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:13:06.827319 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.network.neutron [None req-da94b14c-e97b-47e4-9ef1-421e6f7cde93 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] validate_networks() for [('5332b22b-0717-4e00-8913-c8b77d2d5704', None, None, None, None, None)] {{(pid=118332) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:13:06.924441 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-935bb5c5-38f9-4e26-921a-af4d13d40d96 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-732170147", "imageRef": "37d7ad4a-d925-48e6-84af-ec878f19050e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0627b724-9776-4eb0-bb73-1088cf117d0e"}], "security_groups": [{"name": "tempest-securitygroup--613148993"}], "key_name": "tempest-keypair-569832163", "user_data": "}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:13:07.310544 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.network.neutron [None req-935bb5c5-38f9-4e26-921a-af4d13d40d96 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] validate_networks() for [('0627b724-9776-4eb0-bb73-1088cf117d0e', None, None, None, None, None)] {{(pid=118331) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:13:09.445569 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-935bb5c5-38f9-4e26-921a-af4d13d40d96 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Flavor limits 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:13:09.446322 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-935bb5c5-38f9-4e26-921a-af4d13d40d96 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Image limits 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:13:09.446476 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-935bb5c5-38f9-4e26-921a-af4d13d40d96 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Flavor pref 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:13:09.446897 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-935bb5c5-38f9-4e26-921a-af4d13d40d96 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Image pref 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:13:09.447548 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-935bb5c5-38f9-4e26-921a-af4d13d40d96 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:13:09.465919 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-935bb5c5-38f9-4e26-921a-af4d13d40d96 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:09.466632 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-935bb5c5-38f9-4e26-921a-af4d13d40d96 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:09.467663 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-935bb5c5-38f9-4e26-921a-af4d13d40d96 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:09.468267 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-935bb5c5-38f9-4e26-921a-af4d13d40d96 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:09.491428 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-935bb5c5-38f9-4e26-921a-af4d13d40d96 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Getting quotas for project 050592077e0b4d26a1555d2daa7f460d. Resources: {'instances', 'ram', 'cores'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:13:09.496305 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-935bb5c5-38f9-4e26-921a-af4d13d40d96 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Getting quotas for user 747a608061504d7693f0f99ecdfa476e and project 050592077e0b4d26a1555d2daa7f460d. Resources: {'instances', 'ram', 'cores'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:13:09.512763 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-935bb5c5-38f9-4e26-921a-af4d13d40d96 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Going to run 1 instances... {{(pid=118331) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:13:09.513467 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-935bb5c5-38f9-4e26-921a-af4d13d40d96 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37d7ad4a-d925-48e6-84af-ec878f19050e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:13:09.654160 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-935bb5c5-38f9-4e26-921a-af4d13d40d96 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.738229 Aug 03 05:13:09.655439 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 6/21] 10.222.0.40 () {62 vars in 1188 bytes} [Wed Aug 3 05:13:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 2742 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 03 05:13:09.660789 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-1009b877-3563-4095-9732-5b05eadc8b87 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:09.661646 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-1009b877-3563-4095-9732-5b05eadc8b87 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:09.670457 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1009b877-3563-4095-9732-5b05eadc8b87 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:09.671170 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1009b877-3563-4095-9732-5b05eadc8b87 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:09.672520 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1009b877-3563-4095-9732-5b05eadc8b87 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:09.673120 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1009b877-3563-4095-9732-5b05eadc8b87 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:10.202947 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-1009b877-3563-4095-9732-5b05eadc8b87 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:10.217542 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-1009b877-3563-4095-9732-5b05eadc8b87 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c" status: 200 len: 1280 microversion: 2.1 time: 0.558516 Aug 03 05:13:10.218161 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 7/22] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:09 2022] GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c => generated 1280 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:10.255290 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-06501c2c-3fd0-4af4-b31e-efc1e6fa1187 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:10.257464 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-06501c2c-3fd0-4af4-b31e-efc1e6fa1187 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:10.652255 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-06501c2c-3fd0-4af4-b31e-efc1e6fa1187 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:10.684989 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-06501c2c-3fd0-4af4-b31e-efc1e6fa1187 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:10.710062 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-06501c2c-3fd0-4af4-b31e-efc1e6fa1187 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:10.713426 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-06501c2c-3fd0-4af4-b31e-efc1e6fa1187 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1280 microversion: 2.20 time: 0.491165 Aug 03 05:13:10.714290 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 8/23] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:13:10 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1280 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:13:10.832176 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.virt.hardware [None req-da94b14c-e97b-47e4-9ef1-421e6f7cde93 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Flavor limits 0:0:0 {{(pid=118332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:13:10.833430 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.virt.hardware [None req-da94b14c-e97b-47e4-9ef1-421e6f7cde93 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Image limits 0:0:0 {{(pid=118332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:13:10.833928 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.virt.hardware [None req-da94b14c-e97b-47e4-9ef1-421e6f7cde93 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Flavor pref 0:0:0 {{(pid=118332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:13:10.834356 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.virt.hardware [None req-da94b14c-e97b-47e4-9ef1-421e6f7cde93 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Image pref 0:0:0 {{(pid=118332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:13:10.835767 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.virt.hardware [None req-da94b14c-e97b-47e4-9ef1-421e6f7cde93 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:13:10.882940 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-da94b14c-e97b-47e4-9ef1-421e6f7cde93 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:10.883590 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-da94b14c-e97b-47e4-9ef1-421e6f7cde93 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:10.884715 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-da94b14c-e97b-47e4-9ef1-421e6f7cde93 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:10.885916 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-da94b14c-e97b-47e4-9ef1-421e6f7cde93 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:10.978374 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.quota [None req-da94b14c-e97b-47e4-9ef1-421e6f7cde93 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Getting quotas for project ec7ef948182a457381fd0a686ca298dc. Resources: {'instances', 'ram', 'cores'} {{(pid=118332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:13:11.006181 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.quota [None req-da94b14c-e97b-47e4-9ef1-421e6f7cde93 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Getting quotas for user 41541854b74c49a886db2e7bfa867648 and project ec7ef948182a457381fd0a686ca298dc. Resources: {'instances', 'ram', 'cores'} {{(pid=118332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:13:11.056120 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-da94b14c-e97b-47e4-9ef1-421e6f7cde93 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Going to run 1 instances... {{(pid=118332) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:13:11.071835 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-da94b14c-e97b-47e4-9ef1-421e6f7cde93 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] [instance: 13c9e6de-3618-49eb-b497-a7f7dc44c72b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37d7ad4a-d925-48e6-84af-ec878f19050e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:13:11.253711 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-ef9ac9df-5d50-4e55-9dd1-43ea38c71005 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:11.255018 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-ef9ac9df-5d50-4e55-9dd1-43ea38c71005 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:11.274789 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ef9ac9df-5d50-4e55-9dd1-43ea38c71005 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:11.280334 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ef9ac9df-5d50-4e55-9dd1-43ea38c71005 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:11.283706 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ef9ac9df-5d50-4e55-9dd1-43ea38c71005 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:11.284177 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ef9ac9df-5d50-4e55-9dd1-43ea38c71005 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:11.398544 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-da94b14c-e97b-47e4-9ef1-421e6f7cde93 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.311677 Aug 03 05:13:11.399831 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 16/24] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Aug 3 05:13:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 5313 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 05:13:11.413748 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-e66062f8-8654-452b-ba9e-93641b785023 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:11.414875 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-e66062f8-8654-452b-ba9e-93641b785023 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] [instance: 13c9e6de-3618-49eb-b497-a7f7dc44c72b] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:11.634982 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-e66062f8-8654-452b-ba9e-93641b785023 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41541854b74c49a886db2e7bfa867648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7ef948182a457381fd0a686ca298dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:11.641781 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-e66062f8-8654-452b-ba9e-93641b785023 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] 10.222.0.40 "GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b" status: 200 len: 1214 microversion: 2.1 time: 0.233826 Aug 03 05:13:11.662873 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 17/25] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:11 2022] GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b => generated 1214 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:11.740829 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-6bc293bd-a58f-4025-a968-e1e4cf7945e5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:11.741613 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-6bc293bd-a58f-4025-a968-e1e4cf7945e5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:11.759457 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-6bc293bd-a58f-4025-a968-e1e4cf7945e5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:11.761367 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-6bc293bd-a58f-4025-a968-e1e4cf7945e5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:11.762693 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-6bc293bd-a58f-4025-a968-e1e4cf7945e5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:11.763226 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-6bc293bd-a58f-4025-a968-e1e4cf7945e5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:12.002623 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-ef9ac9df-5d50-4e55-9dd1-43ea38c71005 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:12.025117 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-ef9ac9df-5d50-4e55-9dd1-43ea38c71005 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c" status: 200 len: 1322 microversion: 2.1 time: 0.772696 Aug 03 05:13:12.028567 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 9/26] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:11 2022] GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c => generated 1322 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:12.316282 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-6bc293bd-a58f-4025-a968-e1e4cf7945e5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:12.364434 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-6bc293bd-a58f-4025-a968-e1e4cf7945e5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:12.382019 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-6bc293bd-a58f-4025-a968-e1e4cf7945e5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:12.383892 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-6bc293bd-a58f-4025-a968-e1e4cf7945e5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1284 microversion: 2.20 time: 0.649867 Aug 03 05:13:12.387879 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 18/27] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:13:11 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1284 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:13:12.677545 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-f763dd4e-f153-4276-9c2c-7f638a1a5f2f tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:12.678600 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-f763dd4e-f153-4276-9c2c-7f638a1a5f2f tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] [instance: 13c9e6de-3618-49eb-b497-a7f7dc44c72b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:13.036901 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-f763dd4e-f153-4276-9c2c-7f638a1a5f2f tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41541854b74c49a886db2e7bfa867648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7ef948182a457381fd0a686ca298dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:13.047630 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-f763dd4e-f153-4276-9c2c-7f638a1a5f2f tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] 10.222.0.40 "GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b" status: 200 len: 1214 microversion: 2.1 time: 0.375286 Aug 03 05:13:13.062431 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 10/28] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:12 2022] GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b => generated 1214 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:13.062655 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-8e7031df-18e9-4283-ac8f-e60c6fce37ec tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:13.062655 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-8e7031df-18e9-4283-ac8f-e60c6fce37ec tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:13.073678 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-8e7031df-18e9-4283-ac8f-e60c6fce37ec tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:13.074163 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-8e7031df-18e9-4283-ac8f-e60c6fce37ec tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:13.076701 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-8e7031df-18e9-4283-ac8f-e60c6fce37ec tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:13.078607 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-8e7031df-18e9-4283-ac8f-e60c6fce37ec tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:13.414136 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-5bc2d0a3-190d-4a2c-8bc6-9c155b4a7685 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:13.419284 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-5bc2d0a3-190d-4a2c-8bc6-9c155b4a7685 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:13.429936 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5bc2d0a3-190d-4a2c-8bc6-9c155b4a7685 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:13.435733 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5bc2d0a3-190d-4a2c-8bc6-9c155b4a7685 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:13.451836 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5bc2d0a3-190d-4a2c-8bc6-9c155b4a7685 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:13.452519 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5bc2d0a3-190d-4a2c-8bc6-9c155b4a7685 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:13.869198 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-5bc2d0a3-190d-4a2c-8bc6-9c155b4a7685 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:13.888962 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-5bc2d0a3-190d-4a2c-8bc6-9c155b4a7685 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:13.897195 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-5bc2d0a3-190d-4a2c-8bc6-9c155b4a7685 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:13.899362 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-5bc2d0a3-190d-4a2c-8bc6-9c155b4a7685 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1332 microversion: 2.20 time: 0.489798 Aug 03 05:13:13.928458 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 11/29] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:13:13 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1332 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 05:13:14.073376 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-7b2f6936-1799-48b8-8741-2c9b74ce0876 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:14.074191 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-7b2f6936-1799-48b8-8741-2c9b74ce0876 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] [instance: 13c9e6de-3618-49eb-b497-a7f7dc44c72b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:14.088364 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-8e7031df-18e9-4283-ac8f-e60c6fce37ec tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:14.096361 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7b2f6936-1799-48b8-8741-2c9b74ce0876 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:14.098757 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7b2f6936-1799-48b8-8741-2c9b74ce0876 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:14.101757 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7b2f6936-1799-48b8-8741-2c9b74ce0876 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:14.102464 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7b2f6936-1799-48b8-8741-2c9b74ce0876 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:14.132025 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-8e7031df-18e9-4283-ac8f-e60c6fce37ec tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c" status: 200 len: 1322 microversion: 2.1 time: 1.086968 Aug 03 05:13:14.140508 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 19/30] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:13 2022] GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c => generated 1322 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:13:14.592002 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-7b2f6936-1799-48b8-8741-2c9b74ce0876 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41541854b74c49a886db2e7bfa867648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7ef948182a457381fd0a686ca298dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:14.604961 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-7b2f6936-1799-48b8-8741-2c9b74ce0876 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] 10.222.0.40 "GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b" status: 200 len: 1266 microversion: 2.1 time: 0.537999 Aug 03 05:13:14.610214 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 12/31] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:14 2022] GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b => generated 1266 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:13:14.744835 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-6bba824c-192f-469c-a1fc-91e144cab753 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1006787027", "imageRef": "37d7ad4a-d925-48e6-84af-ec878f19050e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fb45a44c-e06c-4c3d-aeef-17fe7186c5b8"}], "security_groups": [{"name": "tempest-securitygroup--247332817"}], "key_name": "tempest-keypair-575887889", "user_data": "}} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:13:14.932666 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-00e98369-2436-4c68-99a6-f409eb83159d tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:14.933668 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-00e98369-2436-4c68-99a6-f409eb83159d tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:14.949183 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-00e98369-2436-4c68-99a6-f409eb83159d tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:14.957211 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-00e98369-2436-4c68-99a6-f409eb83159d tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:14.968544 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-00e98369-2436-4c68-99a6-f409eb83159d tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:14.975155 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-00e98369-2436-4c68-99a6-f409eb83159d tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:15.611298 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-00e98369-2436-4c68-99a6-f409eb83159d tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:15.624022 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.network.neutron [None req-6bba824c-192f-469c-a1fc-91e144cab753 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] validate_networks() for [('fb45a44c-e06c-4c3d-aeef-17fe7186c5b8', None, None, None, None, None)] {{(pid=118332) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:13:15.625656 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-00e98369-2436-4c68-99a6-f409eb83159d tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:15.637220 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-00e98369-2436-4c68-99a6-f409eb83159d tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:15.638645 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-00e98369-2436-4c68-99a6-f409eb83159d tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1338 microversion: 2.20 time: 0.710153 Aug 03 05:13:15.644195 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 13/32] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:13:14 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1338 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 05:13:15.656313 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-d3c6404a-09c7-458a-b46c-45ef3feb0202 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:15.656867 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-d3c6404a-09c7-458a-b46c-45ef3feb0202 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:15.680233 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d3c6404a-09c7-458a-b46c-45ef3feb0202 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:15.685231 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d3c6404a-09c7-458a-b46c-45ef3feb0202 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:15.686152 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d3c6404a-09c7-458a-b46c-45ef3feb0202 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:15.688324 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d3c6404a-09c7-458a-b46c-45ef3feb0202 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:17.082537 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-d3c6404a-09c7-458a-b46c-45ef3feb0202 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:17.100987 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-d3c6404a-09c7-458a-b46c-45ef3feb0202 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c" status: 200 len: 1322 microversion: 2.1 time: 1.455835 Aug 03 05:13:17.122698 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 14/33] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:15 2022] GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c => generated 1322 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:17.942338 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-99dd9ec8-39b3-4f89-ad75-2bd8e398cb73 req-32629fac-d2ee-42af-aba8-4d22256094a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ee7115a-8a61-415c-a4ba-b53c2aa0c442", "tag": "945d4b78-7ce8-433a-86ca-fd52994ea333"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:13:17.979997 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-99dd9ec8-39b3-4f89-ad75-2bd8e398cb73 req-32629fac-d2ee-42af-aba8-4d22256094a8 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:17.982740 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-99dd9ec8-39b3-4f89-ad75-2bd8e398cb73 req-32629fac-d2ee-42af-aba8-4d22256094a8 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:18.054459 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-99dd9ec8-39b3-4f89-ad75-2bd8e398cb73 req-32629fac-d2ee-42af-aba8-4d22256094a8 service nova] Creating event network-changed:945d4b78-7ce8-433a-86ca-fd52994ea333 for instance 7ee7115a-8a61-415c-a4ba-b53c2aa0c442 on hv-cinder-85127 Aug 03 05:13:18.056444 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-99dd9ec8-39b3-4f89-ad75-2bd8e398cb73 req-32629fac-d2ee-42af-aba8-4d22256094a8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118331) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 03 05:13:18.059421 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d3478435-e5af-4026-884b-f0567562b94f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:18.059981 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d3478435-e5af-4026-884b-f0567562b94f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:18.062637 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d3478435-e5af-4026-884b-f0567562b94f None None] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:18.063134 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d3478435-e5af-4026-884b-f0567562b94f None None] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:18.138180 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.compute.rpcapi [None req-d3478435-e5af-4026-884b-f0567562b94f None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 03 05:13:18.139882 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d3478435-e5af-4026-884b-f0567562b94f None None] Releasing lock "compute-rpcapi-router" {{(pid=118331) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 03 05:13:18.177123 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-d3478435-e5af-4026-884b-f0567562b94f None None] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.050528 Aug 03 05:13:18.179848 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 15/34] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:13:18.200721 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-086c0fe6-0bcf-4398-90e2-a0223cf59813 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:18.202171 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-086c0fe6-0bcf-4398-90e2-a0223cf59813 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] [instance: 13c9e6de-3618-49eb-b497-a7f7dc44c72b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:18.219616 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-086c0fe6-0bcf-4398-90e2-a0223cf59813 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:18.220554 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-086c0fe6-0bcf-4398-90e2-a0223cf59813 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:18.221613 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-086c0fe6-0bcf-4398-90e2-a0223cf59813 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:18.223354 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-086c0fe6-0bcf-4398-90e2-a0223cf59813 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:18.514077 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-086c0fe6-0bcf-4398-90e2-a0223cf59813 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41541854b74c49a886db2e7bfa867648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7ef948182a457381fd0a686ca298dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:18.546868 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-086c0fe6-0bcf-4398-90e2-a0223cf59813 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] 10.222.0.40 "GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b" status: 200 len: 1272 microversion: 2.1 time: 0.354467 Aug 03 05:13:18.548111 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 16/35] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:18 2022] GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b => generated 1272 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:18.575877 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-58db8e36-5650-46bf-8dae-3077c8062c32 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:18.584797 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-58db8e36-5650-46bf-8dae-3077c8062c32 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:18.610054 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-58db8e36-5650-46bf-8dae-3077c8062c32 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:18.610054 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-58db8e36-5650-46bf-8dae-3077c8062c32 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:18.610054 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-58db8e36-5650-46bf-8dae-3077c8062c32 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:18.610054 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-58db8e36-5650-46bf-8dae-3077c8062c32 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:18.889208 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-58db8e36-5650-46bf-8dae-3077c8062c32 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:18.913967 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-58db8e36-5650-46bf-8dae-3077c8062c32 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:18.919609 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-58db8e36-5650-46bf-8dae-3077c8062c32 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:18.926942 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-58db8e36-5650-46bf-8dae-3077c8062c32 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1338 microversion: 2.20 time: 0.375252 Aug 03 05:13:18.928138 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 17/36] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:13:18 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1338 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:13:18.963527 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-94bd1cce-f269-4443-b9b6-4474ac0ad110 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:18.964605 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-94bd1cce-f269-4443-b9b6-4474ac0ad110 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:18.972722 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-94bd1cce-f269-4443-b9b6-4474ac0ad110 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:18.974391 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-94bd1cce-f269-4443-b9b6-4474ac0ad110 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:18.975632 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-94bd1cce-f269-4443-b9b6-4474ac0ad110 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:18.976504 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-94bd1cce-f269-4443-b9b6-4474ac0ad110 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:19.714558 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.virt.hardware [None req-6bba824c-192f-469c-a1fc-91e144cab753 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Flavor limits 0:0:0 {{(pid=118332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:13:19.715865 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.virt.hardware [None req-6bba824c-192f-469c-a1fc-91e144cab753 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Image limits 0:0:0 {{(pid=118332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:13:19.718063 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.virt.hardware [None req-6bba824c-192f-469c-a1fc-91e144cab753 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Flavor pref 0:0:0 {{(pid=118332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:13:19.718063 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.virt.hardware [None req-6bba824c-192f-469c-a1fc-91e144cab753 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Image pref 0:0:0 {{(pid=118332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:13:19.725394 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.virt.hardware [None req-6bba824c-192f-469c-a1fc-91e144cab753 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:13:19.773209 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-6bba824c-192f-469c-a1fc-91e144cab753 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:19.777037 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-6bba824c-192f-469c-a1fc-91e144cab753 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:19.779522 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-6bba824c-192f-469c-a1fc-91e144cab753 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:19.780335 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-6bba824c-192f-469c-a1fc-91e144cab753 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:19.837575 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.quota [None req-6bba824c-192f-469c-a1fc-91e144cab753 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Getting quotas for project 2e1ed25abd8e43009dd8f3f4b7ec1864. Resources: {'instances', 'ram', 'cores'} {{(pid=118332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:13:19.852649 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.quota [None req-6bba824c-192f-469c-a1fc-91e144cab753 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Getting quotas for user f01737ba3200470c8635f335d0338ac8 and project 2e1ed25abd8e43009dd8f3f4b7ec1864. Resources: {'instances', 'ram', 'cores'} {{(pid=118332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:13:19.918329 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-6bba824c-192f-469c-a1fc-91e144cab753 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Going to run 1 instances... {{(pid=118332) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:13:19.924928 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-6bba824c-192f-469c-a1fc-91e144cab753 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37d7ad4a-d925-48e6-84af-ec878f19050e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:13:20.034697 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-94bd1cce-f269-4443-b9b6-4474ac0ad110 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:20.042983 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-94bd1cce-f269-4443-b9b6-4474ac0ad110 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c" status: 200 len: 1322 microversion: 2.1 time: 1.111539 Aug 03 05:13:20.047738 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 18/37] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:18 2022] GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c => generated 1322 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:20.058458 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-5318ff0b-04a1-4979-97b7-5ada5fc54a52 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:20.059428 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-5318ff0b-04a1-4979-97b7-5ada5fc54a52 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] [instance: 13c9e6de-3618-49eb-b497-a7f7dc44c72b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:20.072758 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5318ff0b-04a1-4979-97b7-5ada5fc54a52 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:20.074194 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5318ff0b-04a1-4979-97b7-5ada5fc54a52 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:20.075728 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5318ff0b-04a1-4979-97b7-5ada5fc54a52 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:20.078549 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5318ff0b-04a1-4979-97b7-5ada5fc54a52 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:20.186537 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-6bba824c-192f-469c-a1fc-91e144cab753 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 5.449605 Aug 03 05:13:20.190274 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 20/38] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Aug 3 05:13:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 5454 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 05:13:20.244045 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-cc273115-3485-462f-b935-ae15dc06a2ca tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:20.247578 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-cc273115-3485-462f-b935-ae15dc06a2ca tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:20.252220 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-cc273115-3485-462f-b935-ae15dc06a2ca tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:20.252836 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-cc273115-3485-462f-b935-ae15dc06a2ca tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:20.254459 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-cc273115-3485-462f-b935-ae15dc06a2ca tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:20.255177 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-cc273115-3485-462f-b935-ae15dc06a2ca tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:20.670411 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-5318ff0b-04a1-4979-97b7-5ada5fc54a52 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41541854b74c49a886db2e7bfa867648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7ef948182a457381fd0a686ca298dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:20.682154 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-5318ff0b-04a1-4979-97b7-5ada5fc54a52 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] 10.222.0.40 "GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b" status: 200 len: 1272 microversion: 2.1 time: 0.632180 Aug 03 05:13:20.684508 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 19/39] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:20 2022] GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b => generated 1272 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:20.698953 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-53b46649-712d-4bce-a1a8-08001bbff3ff tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:20.701998 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-53b46649-712d-4bce-a1a8-08001bbff3ff tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:20.944330 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-53b46649-712d-4bce-a1a8-08001bbff3ff tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:20.960333 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-53b46649-712d-4bce-a1a8-08001bbff3ff tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5" status: 200 len: 1237 microversion: 2.1 time: 0.270622 Aug 03 05:13:20.966141 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 20/40] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:20 2022] GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 => generated 1237 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:20.976927 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-10fbf7ad-96a2-4045-87d3-e6df9d37e74c req-27caff01-c551-42f4-8e7e-70b87dc98620 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50296975-4478-4122-a599-548a4cbb582c", "tag": "a1951f3c-b093-496d-be25-7c755eb6f752"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:13:21.019035 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-10fbf7ad-96a2-4045-87d3-e6df9d37e74c req-27caff01-c551-42f4-8e7e-70b87dc98620 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:21.021313 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-10fbf7ad-96a2-4045-87d3-e6df9d37e74c req-27caff01-c551-42f4-8e7e-70b87dc98620 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:21.050293 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-10fbf7ad-96a2-4045-87d3-e6df9d37e74c req-27caff01-c551-42f4-8e7e-70b87dc98620 service nova] Creating event network-changed:a1951f3c-b093-496d-be25-7c755eb6f752 for instance 50296975-4478-4122-a599-548a4cbb582c on hv-cinder-85127 Aug 03 05:13:21.065822 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-10fbf7ad-96a2-4045-87d3-e6df9d37e74c req-27caff01-c551-42f4-8e7e-70b87dc98620 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097777 Aug 03 05:13:21.069087 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 21/41] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:13:21.090428 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-95e75510-9018-4913-85bd-6d7ce305b9d0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:21.095647 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-95e75510-9018-4913-85bd-6d7ce305b9d0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:21.115867 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-95e75510-9018-4913-85bd-6d7ce305b9d0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:21.116834 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-95e75510-9018-4913-85bd-6d7ce305b9d0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:21.118890 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-95e75510-9018-4913-85bd-6d7ce305b9d0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:21.120008 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-95e75510-9018-4913-85bd-6d7ce305b9d0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:21.314774 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-cc273115-3485-462f-b935-ae15dc06a2ca tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:21.333092 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-cc273115-3485-462f-b935-ae15dc06a2ca tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:21.334299 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-cc273115-3485-462f-b935-ae15dc06a2ca tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:21.335856 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-cc273115-3485-462f-b935-ae15dc06a2ca tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1405 microversion: 2.20 time: 1.143165 Aug 03 05:13:21.347088 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 21/42] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:13:20 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1405 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:13:21.725304 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-26bda6b0-ad7a-47e1-ab2d-30cd8d53232e tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:21.727098 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-26bda6b0-ad7a-47e1-ab2d-30cd8d53232e tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] [instance: 13c9e6de-3618-49eb-b497-a7f7dc44c72b] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:21.740343 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-26bda6b0-ad7a-47e1-ab2d-30cd8d53232e tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:21.741474 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-26bda6b0-ad7a-47e1-ab2d-30cd8d53232e tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:21.753337 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-26bda6b0-ad7a-47e1-ab2d-30cd8d53232e tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:21.754430 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-26bda6b0-ad7a-47e1-ab2d-30cd8d53232e tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:22.250184 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-95e75510-9018-4913-85bd-6d7ce305b9d0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:22.267460 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-95e75510-9018-4913-85bd-6d7ce305b9d0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c" status: 200 len: 1322 microversion: 2.1 time: 1.196560 Aug 03 05:13:22.268320 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 22/43] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:21 2022] GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c => generated 1322 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:22.288688 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-b9146e76-9cfd-4de8-902b-2a6b104c5e96 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:22.289570 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-b9146e76-9cfd-4de8-902b-2a6b104c5e96 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:22.297177 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b9146e76-9cfd-4de8-902b-2a6b104c5e96 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:22.297982 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b9146e76-9cfd-4de8-902b-2a6b104c5e96 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:22.298977 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b9146e76-9cfd-4de8-902b-2a6b104c5e96 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:22.299574 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b9146e76-9cfd-4de8-902b-2a6b104c5e96 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:22.445598 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-b9146e76-9cfd-4de8-902b-2a6b104c5e96 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:22.455027 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-b9146e76-9cfd-4de8-902b-2a6b104c5e96 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5" status: 200 len: 1241 microversion: 2.1 time: 0.170688 Aug 03 05:13:22.455885 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 23/44] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:22 2022] GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 => generated 1241 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:22.461344 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-2024426f-2a18-4b25-bf4b-894ccf3500d2 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:22.462221 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-2024426f-2a18-4b25-bf4b-894ccf3500d2 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:22.465460 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:13:22.469266 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2024426f-2a18-4b25-bf4b-894ccf3500d2 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:22.469939 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2024426f-2a18-4b25-bf4b-894ccf3500d2 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:22.471114 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2024426f-2a18-4b25-bf4b-894ccf3500d2 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:22.477937 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2024426f-2a18-4b25-bf4b-894ccf3500d2 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:22.494505 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=100 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:13:22.501498 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-26bda6b0-ad7a-47e1-ab2d-30cd8d53232e tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41541854b74c49a886db2e7bfa867648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7ef948182a457381fd0a686ca298dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:22.510721 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-26bda6b0-ad7a-47e1-ab2d-30cd8d53232e tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] 10.222.0.40 "GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b" status: 200 len: 1314 microversion: 2.1 time: 0.794148 Aug 03 05:13:22.522997 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 22/45] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:21 2022] GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b => generated 1314 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:22.740514 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-2024426f-2a18-4b25-bf4b-894ccf3500d2 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:22.748860 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-2024426f-2a18-4b25-bf4b-894ccf3500d2 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:22.750206 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-2024426f-2a18-4b25-bf4b-894ccf3500d2 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:22.756236 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-2024426f-2a18-4b25-bf4b-894ccf3500d2 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1405 microversion: 2.20 time: 0.299142 Aug 03 05:13:22.758828 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 24/46] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:13:22 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1405 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:13:23.290157 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-84f92a2a-e9bf-4a51-b452-e48d7f4e21cd tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:23.291165 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-84f92a2a-e9bf-4a51-b452-e48d7f4e21cd tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:23.297438 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=8 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:13:23.299774 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-84f92a2a-e9bf-4a51-b452-e48d7f4e21cd tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:23.301132 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-84f92a2a-e9bf-4a51-b452-e48d7f4e21cd tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:23.302231 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-84f92a2a-e9bf-4a51-b452-e48d7f4e21cd tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:23.302931 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-84f92a2a-e9bf-4a51-b452-e48d7f4e21cd tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:23.479107 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-b1020420-8770-403e-9a16-cedab731299d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:23.479525 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-b1020420-8770-403e-9a16-cedab731299d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:23.492814 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b1020420-8770-403e-9a16-cedab731299d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:23.492814 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b1020420-8770-403e-9a16-cedab731299d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:23.499392 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b1020420-8770-403e-9a16-cedab731299d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:23.499865 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b1020420-8770-403e-9a16-cedab731299d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:23.630019 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-b1020420-8770-403e-9a16-cedab731299d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:23.645848 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-b1020420-8770-403e-9a16-cedab731299d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5" status: 200 len: 1289 microversion: 2.1 time: 0.172028 Aug 03 05:13:23.660691 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 25/47] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:23 2022] GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 => generated 1289 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:13:23.675553 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-14ef6a6d-69bf-4b0f-9df8-aa7fb0385e87 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:23.697338 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-14ef6a6d-69bf-4b0f-9df8-aa7fb0385e87 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] [instance: 13c9e6de-3618-49eb-b497-a7f7dc44c72b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:23.714649 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-14ef6a6d-69bf-4b0f-9df8-aa7fb0385e87 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:23.717124 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-14ef6a6d-69bf-4b0f-9df8-aa7fb0385e87 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:23.718523 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-14ef6a6d-69bf-4b0f-9df8-aa7fb0385e87 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:23.720732 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-14ef6a6d-69bf-4b0f-9df8-aa7fb0385e87 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:23.759328 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-84f92a2a-e9bf-4a51-b452-e48d7f4e21cd tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:23.771025 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-84f92a2a-e9bf-4a51-b452-e48d7f4e21cd tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c" status: 200 len: 1322 microversion: 2.1 time: 0.484465 Aug 03 05:13:23.787037 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 23/48] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:23 2022] GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c => generated 1322 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:23.792152 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-2978fc37-483d-40ff-8958-156a5dbcdef4 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:23.792801 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-2978fc37-483d-40ff-8958-156a5dbcdef4 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:23.799948 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-2978fc37-483d-40ff-8958-156a5dbcdef4 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:23.800457 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-2978fc37-483d-40ff-8958-156a5dbcdef4 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:23.802403 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-2978fc37-483d-40ff-8958-156a5dbcdef4 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:23.803065 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-2978fc37-483d-40ff-8958-156a5dbcdef4 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:23.997705 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-14ef6a6d-69bf-4b0f-9df8-aa7fb0385e87 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41541854b74c49a886db2e7bfa867648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7ef948182a457381fd0a686ca298dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:24.007205 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-14ef6a6d-69bf-4b0f-9df8-aa7fb0385e87 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] 10.222.0.40 "GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b" status: 200 len: 1314 microversion: 2.1 time: 0.344763 Aug 03 05:13:24.010889 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 26/49] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:23 2022] GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:24.046436 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-2978fc37-483d-40ff-8958-156a5dbcdef4 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:24.058471 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-2978fc37-483d-40ff-8958-156a5dbcdef4 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:24.060629 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-2978fc37-483d-40ff-8958-156a5dbcdef4 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:24.062965 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-2978fc37-483d-40ff-8958-156a5dbcdef4 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1405 microversion: 2.20 time: 0.275701 Aug 03 05:13:24.064070 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 24/50] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:13:23 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1405 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:13:24.140874 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-a1de4f68-5213-4b87-8d96-c797c371a105 req-ee5448e8-f53d-4823-90bd-44685371356d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69089938-1d69-415c-8344-e6b9f78f16d1", "tag": "602350b3-725c-4735-99e8-acb9b77192fa"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:13:24.150889 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-a1de4f68-5213-4b87-8d96-c797c371a105 req-ee5448e8-f53d-4823-90bd-44685371356d service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:24.151630 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-a1de4f68-5213-4b87-8d96-c797c371a105 req-ee5448e8-f53d-4823-90bd-44685371356d service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:24.163474 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-a1de4f68-5213-4b87-8d96-c797c371a105 req-ee5448e8-f53d-4823-90bd-44685371356d service nova] Creating event network-changed:602350b3-725c-4735-99e8-acb9b77192fa for instance 69089938-1d69-415c-8344-e6b9f78f16d1 on hv-cinder-85127 Aug 03 05:13:24.168495 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-a1de4f68-5213-4b87-8d96-c797c371a105 req-ee5448e8-f53d-4823-90bd-44685371356d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159427 Aug 03 05:13:24.169291 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 27/51] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:13:24.669734 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-02cf2370-3c0c-4a9e-90d6-9f8743341d96 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:24.670427 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-02cf2370-3c0c-4a9e-90d6-9f8743341d96 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:24.680564 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-02cf2370-3c0c-4a9e-90d6-9f8743341d96 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:24.681322 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-02cf2370-3c0c-4a9e-90d6-9f8743341d96 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:24.682244 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-02cf2370-3c0c-4a9e-90d6-9f8743341d96 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:24.682827 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-02cf2370-3c0c-4a9e-90d6-9f8743341d96 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:24.794764 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-85bf652c-deb4-4799-87fc-7817e6cff2fb tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:24.795301 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-02cf2370-3c0c-4a9e-90d6-9f8743341d96 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:24.797328 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-85bf652c-deb4-4799-87fc-7817e6cff2fb tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:24.804438 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-02cf2370-3c0c-4a9e-90d6-9f8743341d96 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5" status: 200 len: 1289 microversion: 2.1 time: 0.138410 Aug 03 05:13:24.805230 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 25/52] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:24 2022] GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 => generated 1289 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:24.825114 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-85bf652c-deb4-4799-87fc-7817e6cff2fb tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:24.826009 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-85bf652c-deb4-4799-87fc-7817e6cff2fb tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:24.827319 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-85bf652c-deb4-4799-87fc-7817e6cff2fb tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:24.828043 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-85bf652c-deb4-4799-87fc-7817e6cff2fb tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:25.031597 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-f5ac8ba3-7e26-4963-ac1a-8df4aff39db2 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:25.032562 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-f5ac8ba3-7e26-4963-ac1a-8df4aff39db2 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] [instance: 13c9e6de-3618-49eb-b497-a7f7dc44c72b] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:25.039398 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f5ac8ba3-7e26-4963-ac1a-8df4aff39db2 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:25.039858 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f5ac8ba3-7e26-4963-ac1a-8df4aff39db2 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:25.040687 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f5ac8ba3-7e26-4963-ac1a-8df4aff39db2 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:25.041125 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f5ac8ba3-7e26-4963-ac1a-8df4aff39db2 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:25.573424 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-85bf652c-deb4-4799-87fc-7817e6cff2fb tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:25.582040 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-85bf652c-deb4-4799-87fc-7817e6cff2fb tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c" status: 200 len: 1322 microversion: 2.1 time: 0.792945 Aug 03 05:13:25.582987 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 28/53] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:24 2022] GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c => generated 1322 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:13:25.588071 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-3c617e1f-67e3-46b4-a3b4-0210b4497dde tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:25.588665 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-3c617e1f-67e3-46b4-a3b4-0210b4497dde tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:25.595837 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3c617e1f-67e3-46b4-a3b4-0210b4497dde tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:25.596476 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3c617e1f-67e3-46b4-a3b4-0210b4497dde tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:25.611732 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3c617e1f-67e3-46b4-a3b4-0210b4497dde tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:25.611732 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3c617e1f-67e3-46b4-a3b4-0210b4497dde tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:25.777084 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-f5ac8ba3-7e26-4963-ac1a-8df4aff39db2 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41541854b74c49a886db2e7bfa867648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7ef948182a457381fd0a686ca298dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:25.799369 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-f5ac8ba3-7e26-4963-ac1a-8df4aff39db2 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] 10.222.0.40 "GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b" status: 200 len: 1314 microversion: 2.1 time: 0.767376 Aug 03 05:13:25.799369 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 26/54] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:25 2022] GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b => generated 1314 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:25.829651 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-cd2b8647-136e-481c-92b9-af608c362a58 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:25.830342 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-cd2b8647-136e-481c-92b9-af608c362a58 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:25.843865 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-cd2b8647-136e-481c-92b9-af608c362a58 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:25.844337 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-cd2b8647-136e-481c-92b9-af608c362a58 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:25.848215 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-cd2b8647-136e-481c-92b9-af608c362a58 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:25.849203 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-cd2b8647-136e-481c-92b9-af608c362a58 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:26.016481 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-3c617e1f-67e3-46b4-a3b4-0210b4497dde tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:26.024598 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-3c617e1f-67e3-46b4-a3b4-0210b4497dde tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:26.026128 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-3c617e1f-67e3-46b4-a3b4-0210b4497dde tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:26.033291 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-3c617e1f-67e3-46b4-a3b4-0210b4497dde tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1405 microversion: 2.20 time: 0.449007 Aug 03 05:13:26.038352 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 29/55] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:13:25 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1405 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:13:26.067264 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-cd2b8647-136e-481c-92b9-af608c362a58 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:26.077051 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-cd2b8647-136e-481c-92b9-af608c362a58 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5" status: 200 len: 1295 microversion: 2.1 time: 0.254192 Aug 03 05:13:26.091659 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 27/56] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:25 2022] GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 => generated 1295 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:13:26.385640 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-4a5a6627-4659-4a9c-b5ba-39605cf1a164 req-ebc17d95-e625-458c-913e-3d9d6dc39ab8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13c9e6de-3618-49eb-b497-a7f7dc44c72b", "tag": "550677a1-2558-4646-a5ec-0573f7db9688"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:13:26.397120 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-4a5a6627-4659-4a9c-b5ba-39605cf1a164 req-ebc17d95-e625-458c-913e-3d9d6dc39ab8 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:26.397882 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-4a5a6627-4659-4a9c-b5ba-39605cf1a164 req-ebc17d95-e625-458c-913e-3d9d6dc39ab8 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:26.422155 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-4a5a6627-4659-4a9c-b5ba-39605cf1a164 req-ebc17d95-e625-458c-913e-3d9d6dc39ab8 service nova] Creating event network-changed:550677a1-2558-4646-a5ec-0573f7db9688 for instance 13c9e6de-3618-49eb-b497-a7f7dc44c72b on hv-cinder-85127 Aug 03 05:13:26.427991 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-4a5a6627-4659-4a9c-b5ba-39605cf1a164 req-ebc17d95-e625-458c-913e-3d9d6dc39ab8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046585 Aug 03 05:13:26.433377 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 30/57] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:13:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:13:26.605589 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-d610340c-8bdf-49d1-b57a-9ac95ef2cc31 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:26.606300 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-d610340c-8bdf-49d1-b57a-9ac95ef2cc31 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:26.615804 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-d610340c-8bdf-49d1-b57a-9ac95ef2cc31 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:26.616553 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-d610340c-8bdf-49d1-b57a-9ac95ef2cc31 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:26.619755 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-d610340c-8bdf-49d1-b57a-9ac95ef2cc31 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:26.619755 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-d610340c-8bdf-49d1-b57a-9ac95ef2cc31 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:26.815741 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-ab9015cb-ee4c-4d7a-8136-4116c1aada00 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:26.817182 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-ab9015cb-ee4c-4d7a-8136-4116c1aada00 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] [instance: 13c9e6de-3618-49eb-b497-a7f7dc44c72b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:26.825328 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ab9015cb-ee4c-4d7a-8136-4116c1aada00 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:26.833856 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ab9015cb-ee4c-4d7a-8136-4116c1aada00 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:26.833856 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ab9015cb-ee4c-4d7a-8136-4116c1aada00 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:26.833856 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ab9015cb-ee4c-4d7a-8136-4116c1aada00 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:26.842312 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-d610340c-8bdf-49d1-b57a-9ac95ef2cc31 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:26.857823 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-d610340c-8bdf-49d1-b57a-9ac95ef2cc31 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c" status: 200 len: 1322 microversion: 2.1 time: 0.257590 Aug 03 05:13:26.858688 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 28/58] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:26 2022] GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c => generated 1322 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:27.034069 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-ab9015cb-ee4c-4d7a-8136-4116c1aada00 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41541854b74c49a886db2e7bfa867648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7ef948182a457381fd0a686ca298dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:27.049732 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-ab9015cb-ee4c-4d7a-8136-4116c1aada00 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] 10.222.0.40 "GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b" status: 200 len: 1314 microversion: 2.1 time: 0.239147 Aug 03 05:13:27.051175 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 31/59] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:26 2022] GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:13:27.065920 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-8a0087c7-70cd-444e-9c9b-7a878510b177 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:27.067263 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-8a0087c7-70cd-444e-9c9b-7a878510b177 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:27.073617 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-8a0087c7-70cd-444e-9c9b-7a878510b177 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:27.074204 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-8a0087c7-70cd-444e-9c9b-7a878510b177 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:27.075024 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-8a0087c7-70cd-444e-9c9b-7a878510b177 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:27.075471 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-8a0087c7-70cd-444e-9c9b-7a878510b177 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:27.103080 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-60212395-5527-42d9-9e46-a168df7e1421 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:27.103783 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-60212395-5527-42d9-9e46-a168df7e1421 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:27.111921 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-60212395-5527-42d9-9e46-a168df7e1421 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:27.112451 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-60212395-5527-42d9-9e46-a168df7e1421 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:27.113855 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-60212395-5527-42d9-9e46-a168df7e1421 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:27.114386 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-60212395-5527-42d9-9e46-a168df7e1421 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:27.274735 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-8a0087c7-70cd-444e-9c9b-7a878510b177 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:27.283688 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-8a0087c7-70cd-444e-9c9b-7a878510b177 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:27.285306 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-8a0087c7-70cd-444e-9c9b-7a878510b177 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:27.286576 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-8a0087c7-70cd-444e-9c9b-7a878510b177 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1405 microversion: 2.20 time: 0.224707 Aug 03 05:13:27.287112 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 29/60] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:13:27 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1405 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:13:27.301464 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-60212395-5527-42d9-9e46-a168df7e1421 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:27.311905 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-60212395-5527-42d9-9e46-a168df7e1421 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5" status: 200 len: 1362 microversion: 2.1 time: 0.210892 Aug 03 05:13:27.313146 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 32/61] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:27 2022] GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 => generated 1362 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:13:27.879191 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-135e6a2d-25ef-4c01-b0a3-466099db02c9 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:27.879924 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-135e6a2d-25ef-4c01-b0a3-466099db02c9 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:27.886020 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-135e6a2d-25ef-4c01-b0a3-466099db02c9 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:27.889883 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-135e6a2d-25ef-4c01-b0a3-466099db02c9 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:27.891455 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-135e6a2d-25ef-4c01-b0a3-466099db02c9 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:27.892066 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-135e6a2d-25ef-4c01-b0a3-466099db02c9 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:28.039087 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-135e6a2d-25ef-4c01-b0a3-466099db02c9 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:28.046923 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-135e6a2d-25ef-4c01-b0a3-466099db02c9 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c" status: 200 len: 1322 microversion: 2.1 time: 0.171807 Aug 03 05:13:28.047523 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 30/62] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:27 2022] GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:28.079610 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-8a53c1ac-b6cb-48fe-9ce7-f8bc7263d235 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:28.080266 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-8a53c1ac-b6cb-48fe-9ce7-f8bc7263d235 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] [instance: 13c9e6de-3618-49eb-b497-a7f7dc44c72b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:28.086938 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8a53c1ac-b6cb-48fe-9ce7-f8bc7263d235 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:28.087401 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8a53c1ac-b6cb-48fe-9ce7-f8bc7263d235 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:28.088170 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8a53c1ac-b6cb-48fe-9ce7-f8bc7263d235 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:28.088613 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8a53c1ac-b6cb-48fe-9ce7-f8bc7263d235 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:28.123493 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell0:SELECT=8 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:13:28.228764 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-8a53c1ac-b6cb-48fe-9ce7-f8bc7263d235 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41541854b74c49a886db2e7bfa867648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7ef948182a457381fd0a686ca298dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:28.236144 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-8a53c1ac-b6cb-48fe-9ce7-f8bc7263d235 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] 10.222.0.40 "GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b" status: 200 len: 1314 microversion: 2.1 time: 0.160538 Aug 03 05:13:28.236716 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 33/63] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:28 2022] GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:28.309557 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-69cb2099-1c52-462a-bf9f-2fc50a245646 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:28.310181 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-69cb2099-1c52-462a-bf9f-2fc50a245646 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:28.316770 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-69cb2099-1c52-462a-bf9f-2fc50a245646 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:28.317222 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-69cb2099-1c52-462a-bf9f-2fc50a245646 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:28.318003 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-69cb2099-1c52-462a-bf9f-2fc50a245646 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:28.318436 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-69cb2099-1c52-462a-bf9f-2fc50a245646 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:28.336007 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-4a34cf7a-8c2c-43e4-85f1-692542623460 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:28.336631 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-4a34cf7a-8c2c-43e4-85f1-692542623460 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:28.342989 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4a34cf7a-8c2c-43e4-85f1-692542623460 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:28.344049 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4a34cf7a-8c2c-43e4-85f1-692542623460 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:28.344821 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4a34cf7a-8c2c-43e4-85f1-692542623460 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:28.345265 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4a34cf7a-8c2c-43e4-85f1-692542623460 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:28.498324 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-69cb2099-1c52-462a-bf9f-2fc50a245646 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:28.507185 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-69cb2099-1c52-462a-bf9f-2fc50a245646 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:28.508709 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-69cb2099-1c52-462a-bf9f-2fc50a245646 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:28.509822 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-69cb2099-1c52-462a-bf9f-2fc50a245646 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1405 microversion: 2.20 time: 0.204168 Aug 03 05:13:28.510399 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 31/64] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:13:28 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1405 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:13:28.538814 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-4a34cf7a-8c2c-43e4-85f1-692542623460 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:28.546618 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-4a34cf7a-8c2c-43e4-85f1-692542623460 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5" status: 200 len: 1362 microversion: 2.1 time: 0.215502 Aug 03 05:13:28.547236 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 34/65] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:28 2022] GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 => generated 1362 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:13:29.067734 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-5423a6be-30f1-40f3-b973-dbeea27579c2 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:29.068422 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-5423a6be-30f1-40f3-b973-dbeea27579c2 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:29.086703 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-5423a6be-30f1-40f3-b973-dbeea27579c2 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:29.086703 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-5423a6be-30f1-40f3-b973-dbeea27579c2 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:29.086703 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-5423a6be-30f1-40f3-b973-dbeea27579c2 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:29.088847 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-5423a6be-30f1-40f3-b973-dbeea27579c2 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:29.256838 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-2634f2c1-58db-4703-82c2-008c0efdb9ff tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:29.257451 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-2634f2c1-58db-4703-82c2-008c0efdb9ff tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] [instance: 13c9e6de-3618-49eb-b497-a7f7dc44c72b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:29.265183 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2634f2c1-58db-4703-82c2-008c0efdb9ff tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:29.265643 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2634f2c1-58db-4703-82c2-008c0efdb9ff tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:29.266715 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2634f2c1-58db-4703-82c2-008c0efdb9ff tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:29.267197 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2634f2c1-58db-4703-82c2-008c0efdb9ff tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:29.283338 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-5423a6be-30f1-40f3-b973-dbeea27579c2 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:29.292497 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-5423a6be-30f1-40f3-b973-dbeea27579c2 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c" status: 200 len: 1322 microversion: 2.1 time: 0.229064 Aug 03 05:13:29.307548 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 32/66] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:29 2022] GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c => generated 1322 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:29.533817 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-e42c5ce7-a269-4b58-8e1c-f7d726e306d0 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:29.534573 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-e42c5ce7-a269-4b58-8e1c-f7d726e306d0 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:29.547747 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-2634f2c1-58db-4703-82c2-008c0efdb9ff tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41541854b74c49a886db2e7bfa867648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7ef948182a457381fd0a686ca298dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:29.559268 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e42c5ce7-a269-4b58-8e1c-f7d726e306d0 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:29.560327 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e42c5ce7-a269-4b58-8e1c-f7d726e306d0 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:29.560465 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-2634f2c1-58db-4703-82c2-008c0efdb9ff tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] 10.222.0.40 "GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b" status: 200 len: 1314 microversion: 2.1 time: 0.307738 Aug 03 05:13:29.561558 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e42c5ce7-a269-4b58-8e1c-f7d726e306d0 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:29.562068 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e42c5ce7-a269-4b58-8e1c-f7d726e306d0 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:29.572425 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 35/67] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:29 2022] GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b => generated 1314 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:13:29.583655 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-a13b1884-ed5a-412b-8232-9c7f15e268c3 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:29.587830 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-a13b1884-ed5a-412b-8232-9c7f15e268c3 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:29.592778 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a13b1884-ed5a-412b-8232-9c7f15e268c3 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:29.593382 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a13b1884-ed5a-412b-8232-9c7f15e268c3 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:29.594466 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a13b1884-ed5a-412b-8232-9c7f15e268c3 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:29.595103 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a13b1884-ed5a-412b-8232-9c7f15e268c3 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:29.815445 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_cell0:SELECT=4 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:13:29.879885 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-e42c5ce7-a269-4b58-8e1c-f7d726e306d0 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:29.885446 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-e42c5ce7-a269-4b58-8e1c-f7d726e306d0 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:29.890224 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-e42c5ce7-a269-4b58-8e1c-f7d726e306d0 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:29.896484 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-e42c5ce7-a269-4b58-8e1c-f7d726e306d0 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1405 microversion: 2.20 time: 0.366424 Aug 03 05:13:29.897072 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 33/68] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:13:29 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1405 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:13:29.919942 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [req-4cb771bd-b895-4047-8eae-e7767f0b6e24 req-8940175b-bb5e-47ac-8008-834307a1fdf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65fc13ab-3930-4958-8f59-759ba1d047b5", "tag": "91c4fc09-87e2-45f6-8784-da65f4ce9033"}]} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:13:29.925973 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_cell0:SELECT=26 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:13:29.957794 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-4cb771bd-b895-4047-8eae-e7767f0b6e24 req-8940175b-bb5e-47ac-8008-834307a1fdf8 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:29.958335 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-4cb771bd-b895-4047-8eae-e7767f0b6e24 req-8940175b-bb5e-47ac-8008-834307a1fdf8 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:30.041866 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.compute.server_external_events [req-4cb771bd-b895-4047-8eae-e7767f0b6e24 req-8940175b-bb5e-47ac-8008-834307a1fdf8 service nova] Creating event network-changed:91c4fc09-87e2-45f6-8784-da65f4ce9033 for instance 65fc13ab-3930-4958-8f59-759ba1d047b5 on hv-cinder-85127 Aug 03 05:13:30.042429 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-4cb771bd-b895-4047-8eae-e7767f0b6e24 req-8940175b-bb5e-47ac-8008-834307a1fdf8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118332) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 03 05:13:30.043703 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-37c6f277-987f-463b-9c14-40354c97e9d8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:30.044152 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-37c6f277-987f-463b-9c14-40354c97e9d8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:30.044953 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-37c6f277-987f-463b-9c14-40354c97e9d8 None None] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:30.045387 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-37c6f277-987f-463b-9c14-40354c97e9d8 None None] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:30.092542 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.compute.rpcapi [None req-37c6f277-987f-463b-9c14-40354c97e9d8 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 03 05:13:30.102064 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-37c6f277-987f-463b-9c14-40354c97e9d8 None None] Releasing lock "compute-rpcapi-router" {{(pid=118332) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 03 05:13:30.136709 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-37c6f277-987f-463b-9c14-40354c97e9d8 None None] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.223877 Aug 03 05:13:30.138980 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 34/69] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:13:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:13:30.316336 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-6789cffa-97f8-43c9-b306-7ae1a76933ed tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:30.318016 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-6789cffa-97f8-43c9-b306-7ae1a76933ed tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:30.328380 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-6789cffa-97f8-43c9-b306-7ae1a76933ed tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:30.329553 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-a13b1884-ed5a-412b-8232-9c7f15e268c3 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:30.330873 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-6789cffa-97f8-43c9-b306-7ae1a76933ed tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:30.332768 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-6789cffa-97f8-43c9-b306-7ae1a76933ed tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:30.335055 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-6789cffa-97f8-43c9-b306-7ae1a76933ed tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:30.351143 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-a13b1884-ed5a-412b-8232-9c7f15e268c3 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5" status: 200 len: 1362 microversion: 2.1 time: 0.766332 Aug 03 05:13:30.351396 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_cell1:SELECT=100 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:13:30.351764 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 36/70] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:29 2022] GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 => generated 1362 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:30.583468 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-eba491db-101b-4bc5-a1c6-82ccd701b962 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:30.584080 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-eba491db-101b-4bc5-a1c6-82ccd701b962 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] [instance: 13c9e6de-3618-49eb-b497-a7f7dc44c72b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:30.591813 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-eba491db-101b-4bc5-a1c6-82ccd701b962 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:30.592678 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-eba491db-101b-4bc5-a1c6-82ccd701b962 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:30.593631 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-eba491db-101b-4bc5-a1c6-82ccd701b962 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:30.594318 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-eba491db-101b-4bc5-a1c6-82ccd701b962 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:30.800530 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-6789cffa-97f8-43c9-b306-7ae1a76933ed tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:30.810011 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-6789cffa-97f8-43c9-b306-7ae1a76933ed tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c" status: 200 len: 1322 microversion: 2.1 time: 0.499684 Aug 03 05:13:30.810709 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 35/71] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:30 2022] GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c => generated 1322 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:13:30.925747 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-a6e3e015-5db2-4c28-86c5-ab37ebe24853 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:30.927579 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-a6e3e015-5db2-4c28-86c5-ab37ebe24853 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:30.929472 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-eba491db-101b-4bc5-a1c6-82ccd701b962 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41541854b74c49a886db2e7bfa867648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7ef948182a457381fd0a686ca298dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:30.934756 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-a6e3e015-5db2-4c28-86c5-ab37ebe24853 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:30.935508 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-a6e3e015-5db2-4c28-86c5-ab37ebe24853 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:30.936495 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-a6e3e015-5db2-4c28-86c5-ab37ebe24853 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:30.937097 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-a6e3e015-5db2-4c28-86c5-ab37ebe24853 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:30.946810 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-eba491db-101b-4bc5-a1c6-82ccd701b962 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] 10.222.0.40 "GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b" status: 200 len: 1314 microversion: 2.1 time: 0.367002 Aug 03 05:13:30.947773 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 37/72] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:30 2022] GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b => generated 1314 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:13:31.103814 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-a6e3e015-5db2-4c28-86c5-ab37ebe24853 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:31.112324 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-a6e3e015-5db2-4c28-86c5-ab37ebe24853 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:31.114698 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-a6e3e015-5db2-4c28-86c5-ab37ebe24853 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:31.116287 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-a6e3e015-5db2-4c28-86c5-ab37ebe24853 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1405 microversion: 2.20 time: 0.195096 Aug 03 05:13:31.117100 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 36/73] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:13:30 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1405 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:13:31.363934 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-893e49a1-e4ae-4d61-9b84-8d547862d61a tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:31.364822 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-893e49a1-e4ae-4d61-9b84-8d547862d61a tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:31.366725 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell0:SELECT=26 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:13:31.371802 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-893e49a1-e4ae-4d61-9b84-8d547862d61a tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:31.372333 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-893e49a1-e4ae-4d61-9b84-8d547862d61a tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:31.373329 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-893e49a1-e4ae-4d61-9b84-8d547862d61a tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:31.373958 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-893e49a1-e4ae-4d61-9b84-8d547862d61a tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:31.530949 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-893e49a1-e4ae-4d61-9b84-8d547862d61a tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:31.540038 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-893e49a1-e4ae-4d61-9b84-8d547862d61a tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5" status: 200 len: 1362 microversion: 2.1 time: 0.179953 Aug 03 05:13:31.541341 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 38/74] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:31 2022] GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:31.832310 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-c6b1b4b1-e532-4f77-bbc9-2d07de344954 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:31.832942 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-c6b1b4b1-e532-4f77-bbc9-2d07de344954 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:31.840930 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-c6b1b4b1-e532-4f77-bbc9-2d07de344954 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:31.841386 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-c6b1b4b1-e532-4f77-bbc9-2d07de344954 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:31.842186 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-c6b1b4b1-e532-4f77-bbc9-2d07de344954 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:31.842617 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-c6b1b4b1-e532-4f77-bbc9-2d07de344954 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:31.967814 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-370e07da-0255-45a5-a0d3-5305c6e3ce17 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:31.968529 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-370e07da-0255-45a5-a0d3-5305c6e3ce17 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] [instance: 13c9e6de-3618-49eb-b497-a7f7dc44c72b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:31.979447 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-370e07da-0255-45a5-a0d3-5305c6e3ce17 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:31.979913 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-370e07da-0255-45a5-a0d3-5305c6e3ce17 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:31.980697 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-370e07da-0255-45a5-a0d3-5305c6e3ce17 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:31.981137 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-370e07da-0255-45a5-a0d3-5305c6e3ce17 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:32.104327 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-c6b1b4b1-e532-4f77-bbc9-2d07de344954 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:32.114644 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-c6b1b4b1-e532-4f77-bbc9-2d07de344954 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c" status: 200 len: 1322 microversion: 2.1 time: 0.286809 Aug 03 05:13:32.128526 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 37/75] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:31 2022] GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c => generated 1322 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:13:32.145594 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-fdd9e936-2d5e-462a-856b-0c9fcec44c7d tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:32.146456 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-fdd9e936-2d5e-462a-856b-0c9fcec44c7d tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:32.163098 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-fdd9e936-2d5e-462a-856b-0c9fcec44c7d tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:32.163426 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-fdd9e936-2d5e-462a-856b-0c9fcec44c7d tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:32.164280 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-fdd9e936-2d5e-462a-856b-0c9fcec44c7d tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:32.164680 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-fdd9e936-2d5e-462a-856b-0c9fcec44c7d tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:32.285118 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-370e07da-0255-45a5-a0d3-5305c6e3ce17 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41541854b74c49a886db2e7bfa867648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7ef948182a457381fd0a686ca298dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:32.296034 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-370e07da-0255-45a5-a0d3-5305c6e3ce17 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] 10.222.0.40 "GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b" status: 200 len: 1314 microversion: 2.1 time: 0.332030 Aug 03 05:13:32.299655 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 39/76] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:31 2022] GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b => generated 1314 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:13:32.604386 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-980e121e-5dc8-4f00-aaad-49c54bcb27f8 req-9fabd6e6-e026-49eb-a3c5-46694db143b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50296975-4478-4122-a599-548a4cbb582c", "name": "network-vif-plugged", "status": "completed", "tag": "a1951f3c-b093-496d-be25-7c755eb6f752"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:13:32.624085 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-980e121e-5dc8-4f00-aaad-49c54bcb27f8 req-9fabd6e6-e026-49eb-a3c5-46694db143b8 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:32.624542 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-980e121e-5dc8-4f00-aaad-49c54bcb27f8 req-9fabd6e6-e026-49eb-a3c5-46694db143b8 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:32.652510 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-980e121e-5dc8-4f00-aaad-49c54bcb27f8 req-9fabd6e6-e026-49eb-a3c5-46694db143b8 service nova] Creating event network-vif-plugged:a1951f3c-b093-496d-be25-7c755eb6f752 for instance 50296975-4478-4122-a599-548a4cbb582c on hv-cinder-85127 Aug 03 05:13:32.657726 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-980e121e-5dc8-4f00-aaad-49c54bcb27f8 req-9fabd6e6-e026-49eb-a3c5-46694db143b8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.287818 Aug 03 05:13:32.658862 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 40/77] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:13:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:13:32.665323 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-66f697fb-299a-4541-9ae9-f7f8ebb7e549 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:32.666586 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-66f697fb-299a-4541-9ae9-f7f8ebb7e549 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:32.674726 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-66f697fb-299a-4541-9ae9-f7f8ebb7e549 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:32.675484 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-66f697fb-299a-4541-9ae9-f7f8ebb7e549 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:32.676468 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-66f697fb-299a-4541-9ae9-f7f8ebb7e549 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:32.677088 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-66f697fb-299a-4541-9ae9-f7f8ebb7e549 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:32.867981 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-fdd9e936-2d5e-462a-856b-0c9fcec44c7d tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:32.877958 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-fdd9e936-2d5e-462a-856b-0c9fcec44c7d tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:32.881089 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-fdd9e936-2d5e-462a-856b-0c9fcec44c7d tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:32.883468 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-fdd9e936-2d5e-462a-856b-0c9fcec44c7d tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1405 microversion: 2.20 time: 0.744174 Aug 03 05:13:32.899086 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 38/78] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:13:32 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1405 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 05:13:32.993267 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-66f697fb-299a-4541-9ae9-f7f8ebb7e549 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:33.004175 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-66f697fb-299a-4541-9ae9-f7f8ebb7e549 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5" status: 200 len: 1362 microversion: 2.1 time: 0.343128 Aug 03 05:13:33.004885 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 41/79] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:32 2022] GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 => generated 1362 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:33.138263 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-03583cb4-9054-4393-8e1e-616e91448141 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:33.138983 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-03583cb4-9054-4393-8e1e-616e91448141 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:33.149282 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-03583cb4-9054-4393-8e1e-616e91448141 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:33.149740 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-03583cb4-9054-4393-8e1e-616e91448141 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:33.150972 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-03583cb4-9054-4393-8e1e-616e91448141 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:33.152021 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-03583cb4-9054-4393-8e1e-616e91448141 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:33.324679 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-669bfeca-e750-46e4-bb9c-663809827f77 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:33.325569 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-669bfeca-e750-46e4-bb9c-663809827f77 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] [instance: 13c9e6de-3618-49eb-b497-a7f7dc44c72b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:33.333700 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-669bfeca-e750-46e4-bb9c-663809827f77 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:33.334522 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-669bfeca-e750-46e4-bb9c-663809827f77 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:33.335700 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-669bfeca-e750-46e4-bb9c-663809827f77 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:33.336151 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-669bfeca-e750-46e4-bb9c-663809827f77 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:33.503798 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-03583cb4-9054-4393-8e1e-616e91448141 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:33.517739 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-03583cb4-9054-4393-8e1e-616e91448141 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c" status: 200 len: 1322 microversion: 2.1 time: 0.385534 Aug 03 05:13:33.518337 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 39/80] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:33 2022] GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c => generated 1322 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:33.585492 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-669bfeca-e750-46e4-bb9c-663809827f77 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41541854b74c49a886db2e7bfa867648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7ef948182a457381fd0a686ca298dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:33.594437 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-669bfeca-e750-46e4-bb9c-663809827f77 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] 10.222.0.40 "GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b" status: 200 len: 1314 microversion: 2.1 time: 0.273559 Aug 03 05:13:33.594437 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 42/81] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:33 2022] GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:13:33.912693 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-180583d8-aa79-4af9-be7b-e5182015382b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:33.913454 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-180583d8-aa79-4af9-be7b-e5182015382b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:33.919997 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-180583d8-aa79-4af9-be7b-e5182015382b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:33.920513 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-180583d8-aa79-4af9-be7b-e5182015382b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:33.921571 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-180583d8-aa79-4af9-be7b-e5182015382b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:33.922068 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-180583d8-aa79-4af9-be7b-e5182015382b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:34.025691 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-e8bd1f8b-9ad8-44fd-8ed6-2e3317f97331 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:34.026324 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-e8bd1f8b-9ad8-44fd-8ed6-2e3317f97331 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:34.033639 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e8bd1f8b-9ad8-44fd-8ed6-2e3317f97331 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:34.034115 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e8bd1f8b-9ad8-44fd-8ed6-2e3317f97331 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:34.035480 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e8bd1f8b-9ad8-44fd-8ed6-2e3317f97331 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:34.035926 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e8bd1f8b-9ad8-44fd-8ed6-2e3317f97331 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:34.040476 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=100 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:13:34.079418 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-180583d8-aa79-4af9-be7b-e5182015382b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:34.088890 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-180583d8-aa79-4af9-be7b-e5182015382b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:34.090979 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-180583d8-aa79-4af9-be7b-e5182015382b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:34.092611 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-180583d8-aa79-4af9-be7b-e5182015382b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1405 microversion: 2.20 time: 0.186976 Aug 03 05:13:34.103432 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 40/82] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:13:33 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1405 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 05:13:34.206928 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-e8bd1f8b-9ad8-44fd-8ed6-2e3317f97331 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:34.217361 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-e8bd1f8b-9ad8-44fd-8ed6-2e3317f97331 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5" status: 200 len: 1362 microversion: 2.1 time: 0.195435 Aug 03 05:13:34.219223 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 43/83] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:34 2022] GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 => generated 1362 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:13:34.545612 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-028aa7f8-1f36-4cd1-beed-799d8bdec55c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:34.546342 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-028aa7f8-1f36-4cd1-beed-799d8bdec55c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:34.552850 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-028aa7f8-1f36-4cd1-beed-799d8bdec55c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:34.554736 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-028aa7f8-1f36-4cd1-beed-799d8bdec55c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:34.555660 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-028aa7f8-1f36-4cd1-beed-799d8bdec55c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:34.556134 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-028aa7f8-1f36-4cd1-beed-799d8bdec55c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:34.616126 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-cfaf0bf6-8047-4f88-bf44-4a6044acd7f8 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:34.616746 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-cfaf0bf6-8047-4f88-bf44-4a6044acd7f8 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] [instance: 13c9e6de-3618-49eb-b497-a7f7dc44c72b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:34.623423 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-cfaf0bf6-8047-4f88-bf44-4a6044acd7f8 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:34.624160 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-cfaf0bf6-8047-4f88-bf44-4a6044acd7f8 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:34.624947 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-cfaf0bf6-8047-4f88-bf44-4a6044acd7f8 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:34.625387 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-cfaf0bf6-8047-4f88-bf44-4a6044acd7f8 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:34.773772 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-028aa7f8-1f36-4cd1-beed-799d8bdec55c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:34.782996 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-028aa7f8-1f36-4cd1-beed-799d8bdec55c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c" status: 200 len: 1322 microversion: 2.1 time: 0.241166 Aug 03 05:13:34.783581 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 41/84] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:34 2022] GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c => generated 1322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:34.788917 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [req-4b2bc36f-59e8-4efc-b17c-1f1838824353 req-7f536385-73c7-436b-8dc2-32a607d570ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ee7115a-8a61-415c-a4ba-b53c2aa0c442", "name": "network-vif-plugged", "status": "completed", "tag": "945d4b78-7ce8-433a-86ca-fd52994ea333"}, {"server_uuid": "13c9e6de-3618-49eb-b497-a7f7dc44c72b", "name": "network-vif-plugged", "status": "completed", "tag": "550677a1-2558-4646-a5ec-0573f7db9688"}]} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:13:34.799537 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-4b2bc36f-59e8-4efc-b17c-1f1838824353 req-7f536385-73c7-436b-8dc2-32a607d570ab service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:34.800330 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-4b2bc36f-59e8-4efc-b17c-1f1838824353 req-7f536385-73c7-436b-8dc2-32a607d570ab service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:34.841937 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.compute.server_external_events [req-4b2bc36f-59e8-4efc-b17c-1f1838824353 req-7f536385-73c7-436b-8dc2-32a607d570ab service nova] Creating event network-vif-plugged:945d4b78-7ce8-433a-86ca-fd52994ea333 for instance 7ee7115a-8a61-415c-a4ba-b53c2aa0c442 on hv-cinder-85127 Aug 03 05:13:34.842679 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.compute.server_external_events [req-4b2bc36f-59e8-4efc-b17c-1f1838824353 req-7f536385-73c7-436b-8dc2-32a607d570ab service nova] Creating event network-vif-plugged:550677a1-2558-4646-a5ec-0573f7db9688 for instance 13c9e6de-3618-49eb-b497-a7f7dc44c72b on hv-cinder-85127 Aug 03 05:13:34.859433 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [req-4b2bc36f-59e8-4efc-b17c-1f1838824353 req-7f536385-73c7-436b-8dc2-32a607d570ab service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.068455 Aug 03 05:13:34.860782 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 42/85] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:13:34 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:13:34.871654 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-cfaf0bf6-8047-4f88-bf44-4a6044acd7f8 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41541854b74c49a886db2e7bfa867648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7ef948182a457381fd0a686ca298dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:34.897122 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-cfaf0bf6-8047-4f88-bf44-4a6044acd7f8 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] 10.222.0.40 "GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b" status: 200 len: 1314 microversion: 2.1 time: 0.285618 Aug 03 05:13:34.902705 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 44/86] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:34 2022] GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:13:35.121262 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-d4261612-461b-48b5-b061-575421db8da3 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:35.122145 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-d4261612-461b-48b5-b061-575421db8da3 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:35.166679 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-d4261612-461b-48b5-b061-575421db8da3 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:35.167712 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-d4261612-461b-48b5-b061-575421db8da3 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:35.169710 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-d4261612-461b-48b5-b061-575421db8da3 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:35.170171 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-d4261612-461b-48b5-b061-575421db8da3 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:35.246726 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-3b59e05a-9b56-4f07-b20f-8189997b1f2a tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:35.247851 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-3b59e05a-9b56-4f07-b20f-8189997b1f2a tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:35.263262 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3b59e05a-9b56-4f07-b20f-8189997b1f2a tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:35.264388 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3b59e05a-9b56-4f07-b20f-8189997b1f2a tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:35.265448 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3b59e05a-9b56-4f07-b20f-8189997b1f2a tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:35.266219 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3b59e05a-9b56-4f07-b20f-8189997b1f2a tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:35.403308 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-d4261612-461b-48b5-b061-575421db8da3 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:35.412551 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-d4261612-461b-48b5-b061-575421db8da3 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:35.414243 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-d4261612-461b-48b5-b061-575421db8da3 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:35.415590 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-d4261612-461b-48b5-b061-575421db8da3 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1405 microversion: 2.20 time: 0.300530 Aug 03 05:13:35.419539 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 43/87] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:13:35 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1405 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 05:13:35.453702 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-3b59e05a-9b56-4f07-b20f-8189997b1f2a tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:35.463606 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-3b59e05a-9b56-4f07-b20f-8189997b1f2a tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5" status: 200 len: 1362 microversion: 2.1 time: 0.224337 Aug 03 05:13:35.464443 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 45/88] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:35 2022] GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 => generated 1362 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:35.804809 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-fca2d11e-cc26-42f5-b4d6-a698bb0d60c3 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:35.805720 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-fca2d11e-cc26-42f5-b4d6-a698bb0d60c3 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:35.812113 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-fca2d11e-cc26-42f5-b4d6-a698bb0d60c3 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:35.813214 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-fca2d11e-cc26-42f5-b4d6-a698bb0d60c3 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:35.816020 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-fca2d11e-cc26-42f5-b4d6-a698bb0d60c3 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:35.816020 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-fca2d11e-cc26-42f5-b4d6-a698bb0d60c3 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:35.927553 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-0c31d627-e91a-4ceb-b70e-6bd0431e5b24 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:35.928292 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-0c31d627-e91a-4ceb-b70e-6bd0431e5b24 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] [instance: 13c9e6de-3618-49eb-b497-a7f7dc44c72b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:35.937591 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0c31d627-e91a-4ceb-b70e-6bd0431e5b24 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:35.938057 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0c31d627-e91a-4ceb-b70e-6bd0431e5b24 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:35.938809 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0c31d627-e91a-4ceb-b70e-6bd0431e5b24 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:35.939278 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0c31d627-e91a-4ceb-b70e-6bd0431e5b24 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:35.963008 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-fca2d11e-cc26-42f5-b4d6-a698bb0d60c3 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:35.974294 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-fca2d11e-cc26-42f5-b4d6-a698bb0d60c3 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c" status: 200 len: 1322 microversion: 2.1 time: 0.173157 Aug 03 05:13:35.975978 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 44/89] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:35 2022] GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:13:36.115802 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-0c31d627-e91a-4ceb-b70e-6bd0431e5b24 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41541854b74c49a886db2e7bfa867648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7ef948182a457381fd0a686ca298dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:36.123563 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-0c31d627-e91a-4ceb-b70e-6bd0431e5b24 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] 10.222.0.40 "GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b" status: 200 len: 1314 microversion: 2.1 time: 0.200415 Aug 03 05:13:36.124299 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 46/90] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:35 2022] GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:13:36.439257 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-f60751e5-001e-41a4-8418-8345872887b1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:36.439939 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-f60751e5-001e-41a4-8418-8345872887b1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:36.447891 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f60751e5-001e-41a4-8418-8345872887b1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:36.448584 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f60751e5-001e-41a4-8418-8345872887b1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:36.449374 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f60751e5-001e-41a4-8418-8345872887b1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:36.449835 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f60751e5-001e-41a4-8418-8345872887b1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:36.493117 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-0758a97a-e6a9-463c-8a0d-e7ae471bba28 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:36.494387 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-0758a97a-e6a9-463c-8a0d-e7ae471bba28 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:36.500633 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0758a97a-e6a9-463c-8a0d-e7ae471bba28 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:36.501204 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0758a97a-e6a9-463c-8a0d-e7ae471bba28 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:36.502130 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0758a97a-e6a9-463c-8a0d-e7ae471bba28 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:36.504795 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0758a97a-e6a9-463c-8a0d-e7ae471bba28 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:36.732461 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-f60751e5-001e-41a4-8418-8345872887b1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:36.743699 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-f60751e5-001e-41a4-8418-8345872887b1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:36.745688 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-f60751e5-001e-41a4-8418-8345872887b1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:36.747097 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-f60751e5-001e-41a4-8418-8345872887b1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1405 microversion: 2.20 time: 0.312240 Aug 03 05:13:36.748813 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 45/91] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:13:36 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1405 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:13:36.772866 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-0758a97a-e6a9-463c-8a0d-e7ae471bba28 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:36.780572 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-0758a97a-e6a9-463c-8a0d-e7ae471bba28 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5" status: 200 len: 1362 microversion: 2.1 time: 0.298920 Aug 03 05:13:36.781162 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 47/92] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:36 2022] GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 => generated 1362 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:13:36.885910 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [req-fe9f52d7-d0bd-4191-8c1f-16be50de6055 req-7a747ac8-94c4-4ff6-bf8d-895c6e90b87b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69089938-1d69-415c-8344-e6b9f78f16d1", "name": "network-vif-plugged", "status": "completed", "tag": "602350b3-725c-4735-99e8-acb9b77192fa"}]} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:13:36.897752 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-fe9f52d7-d0bd-4191-8c1f-16be50de6055 req-7a747ac8-94c4-4ff6-bf8d-895c6e90b87b service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:36.898198 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-fe9f52d7-d0bd-4191-8c1f-16be50de6055 req-7a747ac8-94c4-4ff6-bf8d-895c6e90b87b service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:36.912035 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.compute.server_external_events [req-fe9f52d7-d0bd-4191-8c1f-16be50de6055 req-7a747ac8-94c4-4ff6-bf8d-895c6e90b87b service nova] Creating event network-vif-plugged:602350b3-725c-4735-99e8-acb9b77192fa for instance 69089938-1d69-415c-8344-e6b9f78f16d1 on hv-cinder-85127 Aug 03 05:13:36.917285 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [req-fe9f52d7-d0bd-4191-8c1f-16be50de6055 req-7a747ac8-94c4-4ff6-bf8d-895c6e90b87b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035036 Aug 03 05:13:36.917890 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 46/93] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:13:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:13:37.004381 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-15168f74-c22c-405c-8411-ef395bff00db tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:37.015834 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-15168f74-c22c-405c-8411-ef395bff00db tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:37.024910 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-15168f74-c22c-405c-8411-ef395bff00db tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:37.027580 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-15168f74-c22c-405c-8411-ef395bff00db tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:37.027580 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-15168f74-c22c-405c-8411-ef395bff00db tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:37.027580 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-15168f74-c22c-405c-8411-ef395bff00db tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:37.153871 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-7f57f973-d58c-45a8-a672-caabc73e834d tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:37.153871 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-7f57f973-d58c-45a8-a672-caabc73e834d tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] [instance: 13c9e6de-3618-49eb-b497-a7f7dc44c72b] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:37.166312 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-7f57f973-d58c-45a8-a672-caabc73e834d tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:37.170730 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-7f57f973-d58c-45a8-a672-caabc73e834d tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:37.171684 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-7f57f973-d58c-45a8-a672-caabc73e834d tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:37.172340 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-7f57f973-d58c-45a8-a672-caabc73e834d tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:37.281358 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-15168f74-c22c-405c-8411-ef395bff00db tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:37.291912 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-15168f74-c22c-405c-8411-ef395bff00db tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c" status: 200 len: 1515 microversion: 2.1 time: 0.293803 Aug 03 05:13:37.292503 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 48/94] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:36 2022] GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c => generated 1515 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:37.317211 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-e9caa6cb-fe67-4155-bcac-0b97735c43ba tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:13:37.319524 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-e9caa6cb-fe67-4155-bcac-0b97735c43ba tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:37.325822 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e9caa6cb-fe67-4155-bcac-0b97735c43ba tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:37.326350 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e9caa6cb-fe67-4155-bcac-0b97735c43ba tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:37.327489 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e9caa6cb-fe67-4155-bcac-0b97735c43ba tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:37.327999 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e9caa6cb-fe67-4155-bcac-0b97735c43ba tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:37.372533 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-7f57f973-d58c-45a8-a672-caabc73e834d tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41541854b74c49a886db2e7bfa867648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7ef948182a457381fd0a686ca298dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:37.380906 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-7f57f973-d58c-45a8-a672-caabc73e834d tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] 10.222.0.40 "GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b" status: 200 len: 1314 microversion: 2.1 time: 0.240251 Aug 03 05:13:37.381415 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 47/95] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:37 2022] GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:13:37.408175 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.objects.instance [None req-e9caa6cb-fe67-4155-bcac-0b97735c43ba tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lazy-loading 'flavor' on Instance uuid 50296975-4478-4122-a599-548a4cbb582c {{(pid=118331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:13:37.772314 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-d6010351-d4b6-4b88-a38d-89c4dcc13337 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:37.772974 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-d6010351-d4b6-4b88-a38d-89c4dcc13337 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:37.779305 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-d6010351-d4b6-4b88-a38d-89c4dcc13337 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:37.779902 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-d6010351-d4b6-4b88-a38d-89c4dcc13337 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:37.780671 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-d6010351-d4b6-4b88-a38d-89c4dcc13337 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:37.781102 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-d6010351-d4b6-4b88-a38d-89c4dcc13337 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:37.840459 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-e9caa6cb-fe67-4155-bcac-0b97735c43ba tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "POST /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c/action" status: 200 len: 32 microversion: 2.1 time: 0.527872 Aug 03 05:13:37.845623 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 49/96] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Aug 3 05:13:37 2022] POST /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c/action => generated 32 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 05:13:37.853664 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-b324778e-2d68-4814-90ae-07c46a5caeed tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:37.854351 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-b324778e-2d68-4814-90ae-07c46a5caeed tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:37.876913 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b324778e-2d68-4814-90ae-07c46a5caeed tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:37.877710 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b324778e-2d68-4814-90ae-07c46a5caeed tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:37.879072 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b324778e-2d68-4814-90ae-07c46a5caeed tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:37.879072 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b324778e-2d68-4814-90ae-07c46a5caeed tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:37.993663 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-d6010351-d4b6-4b88-a38d-89c4dcc13337 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:38.005705 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-d6010351-d4b6-4b88-a38d-89c4dcc13337 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:38.007431 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-d6010351-d4b6-4b88-a38d-89c4dcc13337 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:38.008723 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-d6010351-d4b6-4b88-a38d-89c4dcc13337 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1405 microversion: 2.20 time: 0.241107 Aug 03 05:13:38.009267 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 48/97] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:13:37 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1405 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 05:13:38.015229 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-3efa8b54-ea9d-492f-a49f-a4fca055c8a6 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:38.016078 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-3efa8b54-ea9d-492f-a49f-a4fca055c8a6 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:38.026506 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3efa8b54-ea9d-492f-a49f-a4fca055c8a6 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:38.027320 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3efa8b54-ea9d-492f-a49f-a4fca055c8a6 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:38.031468 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3efa8b54-ea9d-492f-a49f-a4fca055c8a6 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:38.031932 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3efa8b54-ea9d-492f-a49f-a4fca055c8a6 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:38.164238 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-b324778e-2d68-4814-90ae-07c46a5caeed tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:38.175316 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-b324778e-2d68-4814-90ae-07c46a5caeed tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5" status: 200 len: 1362 microversion: 2.1 time: 0.331362 Aug 03 05:13:38.177983 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 50/98] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:37 2022] GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 => generated 1362 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:38.280737 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-3efa8b54-ea9d-492f-a49f-a4fca055c8a6 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:38.289321 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-3efa8b54-ea9d-492f-a49f-a4fca055c8a6 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c" status: 200 len: 1521 microversion: 2.1 time: 0.279068 Aug 03 05:13:38.289975 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 49/99] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:38 2022] GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c => generated 1521 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:38.403855 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-a3450672-2436-4fb1-9e68-ec41194c87fa tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:38.404396 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-a3450672-2436-4fb1-9e68-ec41194c87fa tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] [instance: 13c9e6de-3618-49eb-b497-a7f7dc44c72b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:38.411224 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a3450672-2436-4fb1-9e68-ec41194c87fa tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:38.411716 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a3450672-2436-4fb1-9e68-ec41194c87fa tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:38.412489 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a3450672-2436-4fb1-9e68-ec41194c87fa tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:38.412925 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a3450672-2436-4fb1-9e68-ec41194c87fa tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:38.655521 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-a3450672-2436-4fb1-9e68-ec41194c87fa tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41541854b74c49a886db2e7bfa867648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7ef948182a457381fd0a686ca298dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:38.668005 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-a3450672-2436-4fb1-9e68-ec41194c87fa tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] 10.222.0.40 "GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b" status: 200 len: 1501 microversion: 2.1 time: 0.268077 Aug 03 05:13:38.671035 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 51/100] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:38 2022] GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b => generated 1501 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:38.934048 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [req-d3779ce0-ace5-40b9-b5a6-61f635054d98 req-fca33411-4099-40da-ac25-b41e75700859 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65fc13ab-3930-4958-8f59-759ba1d047b5", "name": "network-vif-plugged", "status": "completed", "tag": "91c4fc09-87e2-45f6-8784-da65f4ce9033"}]} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:13:38.948593 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-d3779ce0-ace5-40b9-b5a6-61f635054d98 req-fca33411-4099-40da-ac25-b41e75700859 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:38.949754 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-d3779ce0-ace5-40b9-b5a6-61f635054d98 req-fca33411-4099-40da-ac25-b41e75700859 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:38.972831 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.compute.server_external_events [req-d3779ce0-ace5-40b9-b5a6-61f635054d98 req-fca33411-4099-40da-ac25-b41e75700859 service nova] Creating event network-vif-plugged:91c4fc09-87e2-45f6-8784-da65f4ce9033 for instance 65fc13ab-3930-4958-8f59-759ba1d047b5 on hv-cinder-85127 Aug 03 05:13:38.992410 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [req-d3779ce0-ace5-40b9-b5a6-61f635054d98 req-fca33411-4099-40da-ac25-b41e75700859 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062932 Aug 03 05:13:38.993785 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 50/101] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:13:39.035108 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-8e9f2dc7-f4a2-4bb4-9456-71fe34cba025 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:39.036757 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-8e9f2dc7-f4a2-4bb4-9456-71fe34cba025 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:39.046118 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8e9f2dc7-f4a2-4bb4-9456-71fe34cba025 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:39.046665 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8e9f2dc7-f4a2-4bb4-9456-71fe34cba025 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:39.047563 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8e9f2dc7-f4a2-4bb4-9456-71fe34cba025 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:39.048076 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8e9f2dc7-f4a2-4bb4-9456-71fe34cba025 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:39.197205 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-1a3cc09c-96d0-49c0-ac34-0547d389c9e0 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:39.197968 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-1a3cc09c-96d0-49c0-ac34-0547d389c9e0 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:39.211235 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-1a3cc09c-96d0-49c0-ac34-0547d389c9e0 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:39.211728 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-1a3cc09c-96d0-49c0-ac34-0547d389c9e0 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:39.212509 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-1a3cc09c-96d0-49c0-ac34-0547d389c9e0 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:39.212942 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-1a3cc09c-96d0-49c0-ac34-0547d389c9e0 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:39.320737 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-8e9f2dc7-f4a2-4bb4-9456-71fe34cba025 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:39.350581 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-8e9f2dc7-f4a2-4bb4-9456-71fe34cba025 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:39.365642 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-8e9f2dc7-f4a2-4bb4-9456-71fe34cba025 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:39.368387 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-8e9f2dc7-f4a2-4bb4-9456-71fe34cba025 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1405 microversion: 2.20 time: 0.339503 Aug 03 05:13:39.369873 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 52/102] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:13:39 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1405 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:13:39.378391 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-ef175bb0-abc1-400f-863c-87b214a19711 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:39.379287 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-ef175bb0-abc1-400f-863c-87b214a19711 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:39.387052 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ef175bb0-abc1-400f-863c-87b214a19711 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:39.387784 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ef175bb0-abc1-400f-863c-87b214a19711 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:39.388740 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ef175bb0-abc1-400f-863c-87b214a19711 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:39.389373 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ef175bb0-abc1-400f-863c-87b214a19711 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:39.413519 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-1a3cc09c-96d0-49c0-ac34-0547d389c9e0 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:39.422284 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-1a3cc09c-96d0-49c0-ac34-0547d389c9e0 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5" status: 200 len: 1362 microversion: 2.1 time: 0.229326 Aug 03 05:13:39.423074 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 51/103] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:39 2022] GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 => generated 1362 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:39.587707 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-ef175bb0-abc1-400f-863c-87b214a19711 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:39.595444 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-ef175bb0-abc1-400f-863c-87b214a19711 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c" status: 200 len: 1521 microversion: 2.1 time: 0.224165 Aug 03 05:13:39.596107 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 53/104] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:39 2022] GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:40.394733 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-9e0a9807-6176-4cf3-8245-ce00b782301b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:40.395305 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-9e0a9807-6176-4cf3-8245-ce00b782301b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:40.401310 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-9e0a9807-6176-4cf3-8245-ce00b782301b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:40.402067 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-9e0a9807-6176-4cf3-8245-ce00b782301b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:40.402730 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-9e0a9807-6176-4cf3-8245-ce00b782301b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:40.406391 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-9e0a9807-6176-4cf3-8245-ce00b782301b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:40.446026 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-08b28367-fa24-4acc-aa15-dc78a33d823b tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:40.446380 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-08b28367-fa24-4acc-aa15-dc78a33d823b tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:40.453878 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-08b28367-fa24-4acc-aa15-dc78a33d823b tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:40.454571 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-08b28367-fa24-4acc-aa15-dc78a33d823b tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:40.455545 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-08b28367-fa24-4acc-aa15-dc78a33d823b tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:40.456223 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-08b28367-fa24-4acc-aa15-dc78a33d823b tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:40.625804 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-9e0a9807-6176-4cf3-8245-ce00b782301b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:40.641330 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-9e0a9807-6176-4cf3-8245-ce00b782301b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:40.641330 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-9e0a9807-6176-4cf3-8245-ce00b782301b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:40.642240 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-9e0a9807-6176-4cf3-8245-ce00b782301b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1596 microversion: 2.20 time: 0.252564 Aug 03 05:13:40.642796 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 52/105] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:13:40 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1596 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:13:40.660991 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-4db8e7d1-7e46-470a-808e-d69752f719db tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:40.661621 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-4db8e7d1-7e46-470a-808e-d69752f719db tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:40.668112 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-4db8e7d1-7e46-470a-808e-d69752f719db tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:40.668637 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-4db8e7d1-7e46-470a-808e-d69752f719db tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:40.669423 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-4db8e7d1-7e46-470a-808e-d69752f719db tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:40.669870 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-4db8e7d1-7e46-470a-808e-d69752f719db tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:40.684562 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-08b28367-fa24-4acc-aa15-dc78a33d823b tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:40.695227 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-08b28367-fa24-4acc-aa15-dc78a33d823b tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5" status: 200 len: 1362 microversion: 2.1 time: 0.253351 Aug 03 05:13:40.706591 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 54/106] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:40 2022] GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 => generated 1362 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:13:40.706591 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-716c3976-f85e-46b2-889c-af89c82d68b7 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:40.706591 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-716c3976-f85e-46b2-889c-af89c82d68b7 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:40.708144 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-716c3976-f85e-46b2-889c-af89c82d68b7 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:40.708603 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-716c3976-f85e-46b2-889c-af89c82d68b7 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:40.709410 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-716c3976-f85e-46b2-889c-af89c82d68b7 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:40.709857 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-716c3976-f85e-46b2-889c-af89c82d68b7 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:40.746433 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_cell0:SELECT=2 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:13:40.821840 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-716c3976-f85e-46b2-889c-af89c82d68b7 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.124380 Aug 03 05:13:40.822455 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 55/107] 10.222.0.40 () {60 vars in 1316 bytes} [Wed Aug 3 05:13:40 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1/os-interface => generated 284 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 05:13:40.906292 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-b061c805-6f68-43f6-b024-758ddcd2727b tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "affdb333-40b9-4096-9f9c-d7af9e3a5729"}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:13:40.909257 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-b061c805-6f68-43f6-b024-758ddcd2727b tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] [instance: 13c9e6de-3618-49eb-b497-a7f7dc44c72b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:40.915391 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b061c805-6f68-43f6-b024-758ddcd2727b tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:40.915840 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b061c805-6f68-43f6-b024-758ddcd2727b tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:40.916648 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b061c805-6f68-43f6-b024-758ddcd2727b tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:40.917085 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b061c805-6f68-43f6-b024-758ddcd2727b tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:41.042038 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-4db8e7d1-7e46-470a-808e-d69752f719db tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:41.044311 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_cell1:SELECT=100 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:13:41.053239 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-4db8e7d1-7e46-470a-808e-d69752f719db tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c" status: 200 len: 1521 microversion: 2.1 time: 0.408422 Aug 03 05:13:41.053842 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 53/108] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:40 2022] GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c => generated 1521 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:41.734165 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-9e6f9e11-da80-4a4b-bb42-331cda62cf60 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:41.736060 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-9e6f9e11-da80-4a4b-bb42-331cda62cf60 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:41.773855 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-9e6f9e11-da80-4a4b-bb42-331cda62cf60 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:41.775021 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-9e6f9e11-da80-4a4b-bb42-331cda62cf60 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:41.776211 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-9e6f9e11-da80-4a4b-bb42-331cda62cf60 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:41.778359 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-9e6f9e11-da80-4a4b-bb42-331cda62cf60 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:42.016527 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-9e6f9e11-da80-4a4b-bb42-331cda62cf60 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:42.025233 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-9e6f9e11-da80-4a4b-bb42-331cda62cf60 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5" status: 200 len: 1548 microversion: 2.1 time: 0.302919 Aug 03 05:13:42.028004 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 54/109] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:41 2022] GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 => generated 1548 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:42.051456 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-5f8a664f-33af-4a9e-bdf1-58f6e502c9bf tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:42.051954 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-5f8a664f-33af-4a9e-bdf1-58f6e502c9bf tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:42.057955 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-5f8a664f-33af-4a9e-bdf1-58f6e502c9bf tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:42.058409 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-5f8a664f-33af-4a9e-bdf1-58f6e502c9bf tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:42.059209 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-5f8a664f-33af-4a9e-bdf1-58f6e502c9bf tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:42.059673 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-5f8a664f-33af-4a9e-bdf1-58f6e502c9bf tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:42.239506 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-5f8a664f-33af-4a9e-bdf1-58f6e502c9bf tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.191317 Aug 03 05:13:42.240751 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 55/110] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Aug 3 05:13:42 2022] GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5/os-interface => generated 285 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:13:42.246189 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-b612ce5e-c8a0-4ad0-9e4a-b7901d75c416 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:42.247099 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-b612ce5e-c8a0-4ad0-9e4a-b7901d75c416 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:42.253878 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b612ce5e-c8a0-4ad0-9e4a-b7901d75c416 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:42.255060 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b612ce5e-c8a0-4ad0-9e4a-b7901d75c416 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:42.256184 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b612ce5e-c8a0-4ad0-9e4a-b7901d75c416 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:42.256774 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b612ce5e-c8a0-4ad0-9e4a-b7901d75c416 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:42.459164 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:13:42.531766 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-b612ce5e-c8a0-4ad0-9e4a-b7901d75c416 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:42.543336 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-b612ce5e-c8a0-4ad0-9e4a-b7901d75c416 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c" status: 200 len: 1521 microversion: 2.1 time: 0.301131 Aug 03 05:13:42.544803 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 56/111] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:42 2022] GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c => generated 1521 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:42.544957 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-b061c805-6f68-43f6-b024-758ddcd2727b tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] 10.222.0.40 "POST /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.642364 Aug 03 05:13:42.546275 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 56/112] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Aug 3 05:13:40 2022] POST /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b/os-volume_attachments => generated 194 bytes in 1645 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:13:42.786904 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [req-45e04259-6aff-49e0-9080-8a1d086ef271 req-31e69cf8-47bd-4ff4-8688-4c7616ff33e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69089938-1d69-415c-8344-e6b9f78f16d1", "tag": "602350b3-725c-4735-99e8-acb9b77192fa"}]} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:13:42.797537 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-45e04259-6aff-49e0-9080-8a1d086ef271 req-31e69cf8-47bd-4ff4-8688-4c7616ff33e9 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:42.798357 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-45e04259-6aff-49e0-9080-8a1d086ef271 req-31e69cf8-47bd-4ff4-8688-4c7616ff33e9 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:42.814351 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.compute.server_external_events [req-45e04259-6aff-49e0-9080-8a1d086ef271 req-31e69cf8-47bd-4ff4-8688-4c7616ff33e9 service nova] Creating event network-changed:602350b3-725c-4735-99e8-acb9b77192fa for instance 69089938-1d69-415c-8344-e6b9f78f16d1 on hv-cinder-85127 Aug 03 05:13:42.821153 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [req-45e04259-6aff-49e0-9080-8a1d086ef271 req-31e69cf8-47bd-4ff4-8688-4c7616ff33e9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037848 Aug 03 05:13:42.822186 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 57/113] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:13:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:13:43.576019 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-5a7a63b5-202a-4763-b42d-908402250b7a tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:43.577346 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-5a7a63b5-202a-4763-b42d-908402250b7a tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:43.584772 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5a7a63b5-202a-4763-b42d-908402250b7a tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:43.585468 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5a7a63b5-202a-4763-b42d-908402250b7a tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:43.586412 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5a7a63b5-202a-4763-b42d-908402250b7a tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:43.587053 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5a7a63b5-202a-4763-b42d-908402250b7a tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:43.825677 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-5a7a63b5-202a-4763-b42d-908402250b7a tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:43.825677 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-5a7a63b5-202a-4763-b42d-908402250b7a tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c" status: 200 len: 1521 microversion: 2.1 time: 0.203444 Aug 03 05:13:43.825677 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 57/114] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:43 2022] GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:44.493379 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [req-f7053261-fcfc-47be-97b7-c4a0c66c4985 req-2aee6869-4636-4a1c-9f9e-cb7aa81b636e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65fc13ab-3930-4958-8f59-759ba1d047b5", "tag": "91c4fc09-87e2-45f6-8784-da65f4ce9033"}]} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:13:44.504336 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-f7053261-fcfc-47be-97b7-c4a0c66c4985 req-2aee6869-4636-4a1c-9f9e-cb7aa81b636e service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:44.505109 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-f7053261-fcfc-47be-97b7-c4a0c66c4985 req-2aee6869-4636-4a1c-9f9e-cb7aa81b636e service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:44.521167 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.compute.server_external_events [req-f7053261-fcfc-47be-97b7-c4a0c66c4985 req-2aee6869-4636-4a1c-9f9e-cb7aa81b636e service nova] Creating event network-changed:91c4fc09-87e2-45f6-8784-da65f4ce9033 for instance 65fc13ab-3930-4958-8f59-759ba1d047b5 on hv-cinder-85127 Aug 03 05:13:44.528282 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [req-f7053261-fcfc-47be-97b7-c4a0c66c4985 req-2aee6869-4636-4a1c-9f9e-cb7aa81b636e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038177 Aug 03 05:13:44.529258 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 58/115] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:13:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:13:44.842584 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-865277c4-d1a3-4cb9-a2c9-11b1c666596d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:44.843369 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-865277c4-d1a3-4cb9-a2c9-11b1c666596d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:44.858976 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-865277c4-d1a3-4cb9-a2c9-11b1c666596d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:44.861456 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-865277c4-d1a3-4cb9-a2c9-11b1c666596d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:44.863203 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-865277c4-d1a3-4cb9-a2c9-11b1c666596d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:44.863821 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-865277c4-d1a3-4cb9-a2c9-11b1c666596d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:45.077888 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-865277c4-d1a3-4cb9-a2c9-11b1c666596d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:45.093761 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-865277c4-d1a3-4cb9-a2c9-11b1c666596d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c" status: 200 len: 1521 microversion: 2.1 time: 0.257480 Aug 03 05:13:45.095820 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 58/116] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:44 2022] GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:46.117666 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-b4ac588e-1609-4bff-8a0c-b143ce871395 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:46.118423 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-b4ac588e-1609-4bff-8a0c-b143ce871395 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:46.125622 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b4ac588e-1609-4bff-8a0c-b143ce871395 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:46.126085 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b4ac588e-1609-4bff-8a0c-b143ce871395 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:46.126904 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b4ac588e-1609-4bff-8a0c-b143ce871395 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:46.127378 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b4ac588e-1609-4bff-8a0c-b143ce871395 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:46.264629 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-b4ac588e-1609-4bff-8a0c-b143ce871395 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:46.272644 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-b4ac588e-1609-4bff-8a0c-b143ce871395 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c" status: 200 len: 1521 microversion: 2.1 time: 0.159371 Aug 03 05:13:46.274886 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 59/117] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:46 2022] GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:47.293754 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-ebc35270-b6d0-4c31-83d3-13ae370eded3 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:47.294370 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-ebc35270-b6d0-4c31-83d3-13ae370eded3 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:47.301023 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ebc35270-b6d0-4c31-83d3-13ae370eded3 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:47.301477 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ebc35270-b6d0-4c31-83d3-13ae370eded3 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:47.302251 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ebc35270-b6d0-4c31-83d3-13ae370eded3 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:47.302695 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ebc35270-b6d0-4c31-83d3-13ae370eded3 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:47.439855 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-ebc35270-b6d0-4c31-83d3-13ae370eded3 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:47.447494 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-ebc35270-b6d0-4c31-83d3-13ae370eded3 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c" status: 200 len: 1521 microversion: 2.1 time: 0.157836 Aug 03 05:13:47.448062 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 59/118] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:47 2022] GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:48.468951 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-dfadc8b9-9da9-4a83-97a7-64d6d8415da0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:48.469563 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-dfadc8b9-9da9-4a83-97a7-64d6d8415da0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:48.475892 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-dfadc8b9-9da9-4a83-97a7-64d6d8415da0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:48.476370 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-dfadc8b9-9da9-4a83-97a7-64d6d8415da0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:48.477137 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-dfadc8b9-9da9-4a83-97a7-64d6d8415da0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:48.477573 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-dfadc8b9-9da9-4a83-97a7-64d6d8415da0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:48.867689 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-dfadc8b9-9da9-4a83-97a7-64d6d8415da0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:48.877406 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-dfadc8b9-9da9-4a83-97a7-64d6d8415da0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c" status: 200 len: 1521 microversion: 2.1 time: 0.412319 Aug 03 05:13:48.880606 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 60/119] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:48 2022] GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c => generated 1521 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:49.899070 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-5678ac42-a0de-42c2-a01e-8999bb7db3ae tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:49.899692 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-5678ac42-a0de-42c2-a01e-8999bb7db3ae tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:49.906108 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5678ac42-a0de-42c2-a01e-8999bb7db3ae tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:49.906556 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5678ac42-a0de-42c2-a01e-8999bb7db3ae tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:49.907338 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5678ac42-a0de-42c2-a01e-8999bb7db3ae tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:49.907774 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5678ac42-a0de-42c2-a01e-8999bb7db3ae tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:50.137086 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-5678ac42-a0de-42c2-a01e-8999bb7db3ae tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:50.149124 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-5678ac42-a0de-42c2-a01e-8999bb7db3ae tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c" status: 200 len: 1521 microversion: 2.1 time: 0.253608 Aug 03 05:13:50.151863 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 60/120] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:49 2022] GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:51.171557 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-42096524-92fb-4b05-aca0-84e782dfe063 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:51.172275 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-42096524-92fb-4b05-aca0-84e782dfe063 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:51.180162 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-42096524-92fb-4b05-aca0-84e782dfe063 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:51.180610 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-42096524-92fb-4b05-aca0-84e782dfe063 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:51.181581 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-42096524-92fb-4b05-aca0-84e782dfe063 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:51.182268 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-42096524-92fb-4b05-aca0-84e782dfe063 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:51.404741 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-42096524-92fb-4b05-aca0-84e782dfe063 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:51.413245 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-42096524-92fb-4b05-aca0-84e782dfe063 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c" status: 200 len: 1521 microversion: 2.1 time: 0.245458 Aug 03 05:13:51.414679 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 61/121] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:51 2022] GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:52.435941 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-3f48a5a2-d377-4d73-abc8-d049506a831c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:52.436663 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-3f48a5a2-d377-4d73-abc8-d049506a831c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:52.444605 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3f48a5a2-d377-4d73-abc8-d049506a831c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:52.445156 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3f48a5a2-d377-4d73-abc8-d049506a831c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:52.446325 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3f48a5a2-d377-4d73-abc8-d049506a831c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:52.447060 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3f48a5a2-d377-4d73-abc8-d049506a831c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:52.585939 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-3f48a5a2-d377-4d73-abc8-d049506a831c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:52.594144 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-3f48a5a2-d377-4d73-abc8-d049506a831c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c" status: 200 len: 1521 microversion: 2.1 time: 0.162036 Aug 03 05:13:52.594733 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 61/122] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:52 2022] GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:52.996880 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-6e925814-c785-40c0-b73b-6c5a6f1559b2 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:52.997492 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-6e925814-c785-40c0-b73b-6c5a6f1559b2 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] [instance: 13c9e6de-3618-49eb-b497-a7f7dc44c72b] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:53.003672 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-6e925814-c785-40c0-b73b-6c5a6f1559b2 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:53.004218 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-6e925814-c785-40c0-b73b-6c5a6f1559b2 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:53.005048 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-6e925814-c785-40c0-b73b-6c5a6f1559b2 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:53.005603 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-6e925814-c785-40c0-b73b-6c5a6f1559b2 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:53.042183 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-6e925814-c785-40c0-b73b-6c5a6f1559b2 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] [instance: 13c9e6de-3618-49eb-b497-a7f7dc44c72b] Going to try to terminate instance {{(pid=118332) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:13:53.393766 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-6e925814-c785-40c0-b73b-6c5a6f1559b2 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] 10.222.0.40 "DELETE /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b" status: 204 len: 0 microversion: 2.1 time: 0.401441 Aug 03 05:13:53.395047 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 62/123] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Aug 3 05:13:52 2022] DELETE /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:13:53.403937 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-1f225d70-884c-4e66-8587-0c8e63c881e6 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:53.404665 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-1f225d70-884c-4e66-8587-0c8e63c881e6 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] [instance: 13c9e6de-3618-49eb-b497-a7f7dc44c72b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:53.412658 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1f225d70-884c-4e66-8587-0c8e63c881e6 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:53.413329 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1f225d70-884c-4e66-8587-0c8e63c881e6 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:53.414308 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1f225d70-884c-4e66-8587-0c8e63c881e6 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:53.414817 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1f225d70-884c-4e66-8587-0c8e63c881e6 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:53.560150 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-1f225d70-884c-4e66-8587-0c8e63c881e6 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41541854b74c49a886db2e7bfa867648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7ef948182a457381fd0a686ca298dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:53.569784 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-1f225d70-884c-4e66-8587-0c8e63c881e6 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] 10.222.0.40 "GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b" status: 200 len: 1553 microversion: 2.1 time: 0.169946 Aug 03 05:13:53.570371 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 62/124] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:53 2022] GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b => generated 1553 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:53.616109 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-269c6b5d-51f8-4e22-8bc4-5962194897e5 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:53.616985 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-269c6b5d-51f8-4e22-8bc4-5962194897e5 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:53.623061 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-269c6b5d-51f8-4e22-8bc4-5962194897e5 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:53.623592 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-269c6b5d-51f8-4e22-8bc4-5962194897e5 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:53.624425 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-269c6b5d-51f8-4e22-8bc4-5962194897e5 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:53.624867 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-269c6b5d-51f8-4e22-8bc4-5962194897e5 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:53.762262 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-269c6b5d-51f8-4e22-8bc4-5962194897e5 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:53.799464 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-269c6b5d-51f8-4e22-8bc4-5962194897e5 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c" status: 200 len: 1521 microversion: 2.1 time: 0.179925 Aug 03 05:13:53.799464 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 63/125] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:53 2022] GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:54.591024 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-991d6d09-574e-492a-ae50-166157cb2457 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:54.591639 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-991d6d09-574e-492a-ae50-166157cb2457 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] [instance: 13c9e6de-3618-49eb-b497-a7f7dc44c72b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:54.598468 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-991d6d09-574e-492a-ae50-166157cb2457 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:54.598940 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-991d6d09-574e-492a-ae50-166157cb2457 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:54.599699 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-991d6d09-574e-492a-ae50-166157cb2457 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:54.600137 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-991d6d09-574e-492a-ae50-166157cb2457 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:54.741144 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-991d6d09-574e-492a-ae50-166157cb2457 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41541854b74c49a886db2e7bfa867648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7ef948182a457381fd0a686ca298dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:54.749677 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-991d6d09-574e-492a-ae50-166157cb2457 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] 10.222.0.40 "GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b" status: 200 len: 1553 microversion: 2.1 time: 0.162516 Aug 03 05:13:54.750255 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 63/126] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:54 2022] GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b => generated 1553 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:54.818241 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-739129f5-6286-4f33-a3b0-543ebf83f843 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:54.818874 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-739129f5-6286-4f33-a3b0-543ebf83f843 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:54.829239 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-739129f5-6286-4f33-a3b0-543ebf83f843 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:54.830464 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-739129f5-6286-4f33-a3b0-543ebf83f843 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:54.831879 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-739129f5-6286-4f33-a3b0-543ebf83f843 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:54.832601 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-739129f5-6286-4f33-a3b0-543ebf83f843 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:54.982263 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-739129f5-6286-4f33-a3b0-543ebf83f843 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:54.990306 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-739129f5-6286-4f33-a3b0-543ebf83f843 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c" status: 200 len: 1521 microversion: 2.1 time: 0.181392 Aug 03 05:13:54.990920 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 64/127] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:54 2022] GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:55.771834 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-14fcce65-d36a-4e7f-b063-0f2b9a937d00 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:55.772343 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-14fcce65-d36a-4e7f-b063-0f2b9a937d00 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] [instance: 13c9e6de-3618-49eb-b497-a7f7dc44c72b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:55.774940 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_api:SELECT=79 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:13:55.779872 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-14fcce65-d36a-4e7f-b063-0f2b9a937d00 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:55.780319 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-14fcce65-d36a-4e7f-b063-0f2b9a937d00 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:55.781229 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-14fcce65-d36a-4e7f-b063-0f2b9a937d00 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:55.781501 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-14fcce65-d36a-4e7f-b063-0f2b9a937d00 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:55.957245 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-14fcce65-d36a-4e7f-b063-0f2b9a937d00 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41541854b74c49a886db2e7bfa867648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7ef948182a457381fd0a686ca298dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:55.967445 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-14fcce65-d36a-4e7f-b063-0f2b9a937d00 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] 10.222.0.40 "GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b" status: 200 len: 1553 microversion: 2.1 time: 0.198430 Aug 03 05:13:55.983047 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 64/128] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:55 2022] GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b => generated 1553 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:56.013558 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-0acaa1b7-52b1-4edb-b6b2-8f53bf7a3e57 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:56.014178 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-0acaa1b7-52b1-4edb-b6b2-8f53bf7a3e57 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:56.016143 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:13:56.020967 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-0acaa1b7-52b1-4edb-b6b2-8f53bf7a3e57 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:56.021422 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-0acaa1b7-52b1-4edb-b6b2-8f53bf7a3e57 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:56.022192 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-0acaa1b7-52b1-4edb-b6b2-8f53bf7a3e57 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:56.022634 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-0acaa1b7-52b1-4edb-b6b2-8f53bf7a3e57 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:56.171662 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-0acaa1b7-52b1-4edb-b6b2-8f53bf7a3e57 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:56.195044 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-0acaa1b7-52b1-4edb-b6b2-8f53bf7a3e57 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c" status: 200 len: 1521 microversion: 2.1 time: 0.182451 Aug 03 05:13:56.195044 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 65/129] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:56 2022] GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:56.990304 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-7395a31b-eec5-4bd7-a838-f48a2446c187 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:56.990947 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-7395a31b-eec5-4bd7-a838-f48a2446c187 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] [instance: 13c9e6de-3618-49eb-b497-a7f7dc44c72b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:56.997450 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7395a31b-eec5-4bd7-a838-f48a2446c187 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:56.997914 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7395a31b-eec5-4bd7-a838-f48a2446c187 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:56.998685 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7395a31b-eec5-4bd7-a838-f48a2446c187 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:56.999161 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7395a31b-eec5-4bd7-a838-f48a2446c187 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:57.141196 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-7395a31b-eec5-4bd7-a838-f48a2446c187 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41541854b74c49a886db2e7bfa867648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7ef948182a457381fd0a686ca298dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:57.149160 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-7395a31b-eec5-4bd7-a838-f48a2446c187 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] 10.222.0.40 "GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b" status: 200 len: 1553 microversion: 2.1 time: 0.163684 Aug 03 05:13:57.149738 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 65/130] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:56 2022] GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b => generated 1553 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:57.214326 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-fc54a7c1-e72c-405b-b6fb-f98f01392328 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:57.215003 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-fc54a7c1-e72c-405b-b6fb-f98f01392328 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:57.221515 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-fc54a7c1-e72c-405b-b6fb-f98f01392328 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:57.221960 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-fc54a7c1-e72c-405b-b6fb-f98f01392328 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:57.223348 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-fc54a7c1-e72c-405b-b6fb-f98f01392328 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:57.223765 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-fc54a7c1-e72c-405b-b6fb-f98f01392328 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:57.352750 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-fc54a7c1-e72c-405b-b6fb-f98f01392328 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:57.360277 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-fc54a7c1-e72c-405b-b6fb-f98f01392328 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c" status: 200 len: 1521 microversion: 2.1 time: 0.149660 Aug 03 05:13:57.361336 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 66/131] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:57 2022] GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:58.170834 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-0c5e437d-47a5-4f8e-9e29-7f80d407f37b tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:58.171444 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-0c5e437d-47a5-4f8e-9e29-7f80d407f37b tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] [instance: 13c9e6de-3618-49eb-b497-a7f7dc44c72b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:58.177864 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0c5e437d-47a5-4f8e-9e29-7f80d407f37b tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:58.178336 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0c5e437d-47a5-4f8e-9e29-7f80d407f37b tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:58.179119 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0c5e437d-47a5-4f8e-9e29-7f80d407f37b tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:58.179552 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0c5e437d-47a5-4f8e-9e29-7f80d407f37b tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:58.337177 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-0c5e437d-47a5-4f8e-9e29-7f80d407f37b tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41541854b74c49a886db2e7bfa867648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7ef948182a457381fd0a686ca298dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:58.346246 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-0c5e437d-47a5-4f8e-9e29-7f80d407f37b tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] 10.222.0.40 "GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b" status: 200 len: 1553 microversion: 2.1 time: 0.179162 Aug 03 05:13:58.346875 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 66/132] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:58 2022] GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b => generated 1553 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:58.382314 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-441e9ecc-be12-4a4c-92c1-1f09421cc70a tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:58.383100 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-441e9ecc-be12-4a4c-92c1-1f09421cc70a tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:58.389320 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-441e9ecc-be12-4a4c-92c1-1f09421cc70a tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:58.390164 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-441e9ecc-be12-4a4c-92c1-1f09421cc70a tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:58.396764 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-441e9ecc-be12-4a4c-92c1-1f09421cc70a tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:58.396764 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-441e9ecc-be12-4a4c-92c1-1f09421cc70a tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:58.542668 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-441e9ecc-be12-4a4c-92c1-1f09421cc70a tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:58.554903 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-441e9ecc-be12-4a4c-92c1-1f09421cc70a tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c" status: 200 len: 1521 microversion: 2.1 time: 0.176635 Aug 03 05:13:58.555789 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 67/133] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:58 2022] GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:59.150027 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-858e22f3-25f2-4ac1-87bb-d670b789cc7e req-cf635e8f-f948-46ab-8d29-2e0c67f32f7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13c9e6de-3618-49eb-b497-a7f7dc44c72b", "name": "network-vif-deleted", "tag": "550677a1-2558-4646-a5ec-0573f7db9688"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:13:59.171194 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-858e22f3-25f2-4ac1-87bb-d670b789cc7e req-cf635e8f-f948-46ab-8d29-2e0c67f32f7d service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:59.171828 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-858e22f3-25f2-4ac1-87bb-d670b789cc7e req-cf635e8f-f948-46ab-8d29-2e0c67f32f7d service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:59.191658 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-858e22f3-25f2-4ac1-87bb-d670b789cc7e req-cf635e8f-f948-46ab-8d29-2e0c67f32f7d service nova] Creating event network-vif-deleted:550677a1-2558-4646-a5ec-0573f7db9688 for instance 13c9e6de-3618-49eb-b497-a7f7dc44c72b on hv-cinder-85127 Aug 03 05:13:59.197241 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-858e22f3-25f2-4ac1-87bb-d670b789cc7e req-cf635e8f-f948-46ab-8d29-2e0c67f32f7d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056787 Aug 03 05:13:59.198294 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 67/134] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:13:59.370615 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-70c0f6a6-b991-4bb2-965b-5d936d80688d tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:59.371286 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-70c0f6a6-b991-4bb2-965b-5d936d80688d tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] [instance: 13c9e6de-3618-49eb-b497-a7f7dc44c72b] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:59.378124 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-70c0f6a6-b991-4bb2-965b-5d936d80688d tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:59.378524 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-70c0f6a6-b991-4bb2-965b-5d936d80688d tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:59.379496 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-70c0f6a6-b991-4bb2-965b-5d936d80688d tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:59.379940 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-70c0f6a6-b991-4bb2-965b-5d936d80688d tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:59.470029 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-70c0f6a6-b991-4bb2-965b-5d936d80688d tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41541854b74c49a886db2e7bfa867648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7ef948182a457381fd0a686ca298dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:59.479448 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-70c0f6a6-b991-4bb2-965b-5d936d80688d tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] 10.222.0.40 "GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b" status: 200 len: 1345 microversion: 2.1 time: 0.112719 Aug 03 05:13:59.480230 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 68/135] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:59 2022] GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b => generated 1345 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:59.578519 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-789b8613-34aa-4eb1-9025-2fe20b40f4e4 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:59.579368 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-789b8613-34aa-4eb1-9025-2fe20b40f4e4 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:59.585532 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-789b8613-34aa-4eb1-9025-2fe20b40f4e4 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:59.585985 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-789b8613-34aa-4eb1-9025-2fe20b40f4e4 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:59.586747 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-789b8613-34aa-4eb1-9025-2fe20b40f4e4 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:59.587215 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-789b8613-34aa-4eb1-9025-2fe20b40f4e4 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:59.765656 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-789b8613-34aa-4eb1-9025-2fe20b40f4e4 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:59.775258 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-789b8613-34aa-4eb1-9025-2fe20b40f4e4 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c" status: 200 len: 1521 microversion: 2.1 time: 0.200900 Aug 03 05:13:59.790361 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 68/136] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:59 2022] GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:00.502499 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-c8299d54-56a1-4b35-8014-ae24ba59395b tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:00.503733 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-c8299d54-56a1-4b35-8014-ae24ba59395b tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] [instance: 13c9e6de-3618-49eb-b497-a7f7dc44c72b] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:00.513184 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-c8299d54-56a1-4b35-8014-ae24ba59395b tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:00.513859 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-c8299d54-56a1-4b35-8014-ae24ba59395b tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:00.514931 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-c8299d54-56a1-4b35-8014-ae24ba59395b tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:00.515631 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-c8299d54-56a1-4b35-8014-ae24ba59395b tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:00.578303 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-c8299d54-56a1-4b35-8014-ae24ba59395b tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41541854b74c49a886db2e7bfa867648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7ef948182a457381fd0a686ca298dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:00.586936 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-c8299d54-56a1-4b35-8014-ae24ba59395b tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] 10.222.0.40 "GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b" status: 200 len: 1345 microversion: 2.1 time: 0.089245 Aug 03 05:14:00.587520 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 69/137] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:00 2022] GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b => generated 1345 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:00.796738 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-13e888a4-5872-4d05-8f86-f757b9b0526b tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:00.797341 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-13e888a4-5872-4d05-8f86-f757b9b0526b tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:00.804076 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-13e888a4-5872-4d05-8f86-f757b9b0526b tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:00.804659 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-13e888a4-5872-4d05-8f86-f757b9b0526b tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:00.805431 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-13e888a4-5872-4d05-8f86-f757b9b0526b tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:00.805868 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-13e888a4-5872-4d05-8f86-f757b9b0526b tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:00.969183 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-13e888a4-5872-4d05-8f86-f757b9b0526b tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:00.977560 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-13e888a4-5872-4d05-8f86-f757b9b0526b tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c" status: 200 len: 1521 microversion: 2.1 time: 0.184615 Aug 03 05:14:00.978123 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 69/138] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:00 2022] GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:01.608355 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-07cf4064-8b49-4a88-adca-7af2ec20fcc3 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:01.609062 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-07cf4064-8b49-4a88-adca-7af2ec20fcc3 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] [instance: 13c9e6de-3618-49eb-b497-a7f7dc44c72b] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:01.616030 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-07cf4064-8b49-4a88-adca-7af2ec20fcc3 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:01.616640 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-07cf4064-8b49-4a88-adca-7af2ec20fcc3 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:01.617421 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-07cf4064-8b49-4a88-adca-7af2ec20fcc3 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:01.617859 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-07cf4064-8b49-4a88-adca-7af2ec20fcc3 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:01.636330 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:14:01.683561 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-07cf4064-8b49-4a88-adca-7af2ec20fcc3 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41541854b74c49a886db2e7bfa867648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7ef948182a457381fd0a686ca298dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:01.692191 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-07cf4064-8b49-4a88-adca-7af2ec20fcc3 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] 10.222.0.40 "GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b" status: 200 len: 1345 microversion: 2.1 time: 0.087673 Aug 03 05:14:01.695507 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 70/139] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:01 2022] GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b => generated 1345 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:01.997773 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-f86bfc66-49a6-4cad-867c-5d5ba253580e tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:01.998422 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-f86bfc66-49a6-4cad-867c-5d5ba253580e tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:02.005075 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f86bfc66-49a6-4cad-867c-5d5ba253580e tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:02.005532 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f86bfc66-49a6-4cad-867c-5d5ba253580e tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:02.006310 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f86bfc66-49a6-4cad-867c-5d5ba253580e tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:02.006756 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f86bfc66-49a6-4cad-867c-5d5ba253580e tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:02.156993 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-f86bfc66-49a6-4cad-867c-5d5ba253580e tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:02.165348 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-f86bfc66-49a6-4cad-867c-5d5ba253580e tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c" status: 200 len: 1521 microversion: 2.1 time: 0.171479 Aug 03 05:14:02.166027 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 70/140] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:01 2022] GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:02.716239 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-e2e52e08-8226-4d3c-b308-35a3ae82ba81 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:02.716915 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-e2e52e08-8226-4d3c-b308-35a3ae82ba81 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] [instance: 13c9e6de-3618-49eb-b497-a7f7dc44c72b] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:02.726407 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e2e52e08-8226-4d3c-b308-35a3ae82ba81 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:02.726407 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e2e52e08-8226-4d3c-b308-35a3ae82ba81 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:02.726407 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e2e52e08-8226-4d3c-b308-35a3ae82ba81 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:02.726407 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e2e52e08-8226-4d3c-b308-35a3ae82ba81 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:02.796651 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-e2e52e08-8226-4d3c-b308-35a3ae82ba81 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41541854b74c49a886db2e7bfa867648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7ef948182a457381fd0a686ca298dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:02.807060 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-e2e52e08-8226-4d3c-b308-35a3ae82ba81 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] 10.222.0.40 "GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b" status: 200 len: 1345 microversion: 2.1 time: 0.095151 Aug 03 05:14:02.810386 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 71/141] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:02 2022] GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b => generated 1345 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:03.186923 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-7f99698a-3c33-49ce-b980-dd7ceea79755 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:03.187551 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-7f99698a-3c33-49ce-b980-dd7ceea79755 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:03.194802 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7f99698a-3c33-49ce-b980-dd7ceea79755 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:03.195301 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7f99698a-3c33-49ce-b980-dd7ceea79755 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:03.196074 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7f99698a-3c33-49ce-b980-dd7ceea79755 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:03.196520 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7f99698a-3c33-49ce-b980-dd7ceea79755 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:03.386088 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-7f99698a-3c33-49ce-b980-dd7ceea79755 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:03.394135 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-7f99698a-3c33-49ce-b980-dd7ceea79755 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c" status: 200 len: 1521 microversion: 2.1 time: 0.211173 Aug 03 05:14:03.394740 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 71/142] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:03 2022] GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:14:03.828889 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-10cf3370-359a-4c13-9d96-90db4e48195b tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:03.830001 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-10cf3370-359a-4c13-9d96-90db4e48195b tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] [instance: 13c9e6de-3618-49eb-b497-a7f7dc44c72b] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:03.840779 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-10cf3370-359a-4c13-9d96-90db4e48195b tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:03.841463 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-10cf3370-359a-4c13-9d96-90db4e48195b tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:03.842592 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-10cf3370-359a-4c13-9d96-90db4e48195b tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:03.843250 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-10cf3370-359a-4c13-9d96-90db4e48195b tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:03.877442 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-10cf3370-359a-4c13-9d96-90db4e48195b tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:03.877892 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-10cf3370-359a-4c13-9d96-90db4e48195b tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:03.878353 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.objects.instance [None req-10cf3370-359a-4c13-9d96-90db4e48195b tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lazy-loading 'fault' on Instance uuid 13c9e6de-3618-49eb-b497-a7f7dc44c72b {{(pid=118332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:14:03.927311 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-10cf3370-359a-4c13-9d96-90db4e48195b tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41541854b74c49a886db2e7bfa867648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7ef948182a457381fd0a686ca298dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:03.936723 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-10cf3370-359a-4c13-9d96-90db4e48195b tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] 10.222.0.40 "GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b" status: 200 len: 1350 microversion: 2.1 time: 0.111447 Aug 03 05:14:03.950469 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 72/143] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:03 2022] GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b => generated 1350 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:04.416140 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-6affecb7-7bf5-404d-9c37-c5b072ffff03 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:04.416841 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-6affecb7-7bf5-404d-9c37-c5b072ffff03 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:04.424404 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6affecb7-7bf5-404d-9c37-c5b072ffff03 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:04.424768 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6affecb7-7bf5-404d-9c37-c5b072ffff03 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:04.425545 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6affecb7-7bf5-404d-9c37-c5b072ffff03 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:04.425987 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6affecb7-7bf5-404d-9c37-c5b072ffff03 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:04.576743 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-6affecb7-7bf5-404d-9c37-c5b072ffff03 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:04.584389 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-6affecb7-7bf5-404d-9c37-c5b072ffff03 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c" status: 200 len: 1521 microversion: 2.1 time: 0.172288 Aug 03 05:14:04.585010 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 72/144] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:04 2022] GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:04.961565 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-8e9bad51-f7d2-4c70-8ded-2c72f44dae17 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:04.962176 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-8e9bad51-f7d2-4c70-8ded-2c72f44dae17 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] [instance: 13c9e6de-3618-49eb-b497-a7f7dc44c72b] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:04.969023 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-8e9bad51-f7d2-4c70-8ded-2c72f44dae17 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:04.969487 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-8e9bad51-f7d2-4c70-8ded-2c72f44dae17 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:04.970871 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-8e9bad51-f7d2-4c70-8ded-2c72f44dae17 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:04.971310 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-8e9bad51-f7d2-4c70-8ded-2c72f44dae17 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:04.988251 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.wsgi [None req-8e9bad51-f7d2-4c70-8ded-2c72f44dae17 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] HTTP exception thrown: Instance 13c9e6de-3618-49eb-b497-a7f7dc44c72b could not be found. Aug 03 05:14:04.993200 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-8e9bad51-f7d2-4c70-8ded-2c72f44dae17 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Request method failure captured: Aug 03 05:14:04.993200 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: request: GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b HTTP/1.1 Aug 03 05:14:04.993200 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Accept: application/json Aug 03 05:14:04.993200 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Accept-Encoding: identity Aug 03 05:14:04.993200 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Connection: close Aug 03 05:14:04.993200 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Content-Length: 0 Aug 03 05:14:04.993200 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Content-Type: application/json Aug 03 05:14:04.993200 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Host: 10.222.0.40 Aug 03 05:14:04.993200 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Openstack-System-Scope: None Aug 03 05:14:04.993200 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: User-Agent: python-urllib3/1.26.10 Aug 03 05:14:04.993200 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Auth-Token: gAAAAABi6gPhwciLyhXYqSRn5tA-Y7cN3wj8IlQlwA-IplbCrPZrkQfyzwX1GlXVvlDL8H9Rpcz7EUrRMW4k2SuGmblz_FDqBjpeZRYvxuTUnvkoNj3-FeFpOPw8cR1J9pVXNm5wirOSXJZomyU1TrVLEDYbA6TB5LqCtl0EX2uVlsPwWPHmvmM Aug 03 05:14:04.993200 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Domain-Id: None Aug 03 05:14:04.993200 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Domain-Name: None Aug 03 05:14:04.993200 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Identity-Status: Confirmed Aug 03 05:14:04.993200 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Is-Admin-Project: True Aug 03 05:14:04.993200 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Domain-Id: default Aug 03 05:14:04.993200 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Domain-Name: Default Aug 03 05:14:04.993200 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Id: ec7ef948182a457381fd0a686ca298dc Aug 03 05:14:04.993200 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Name: tempest-DeleteServersTestJSON-966657975 Aug 03 05:14:04.993200 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Role: member,reader Aug 03 05:14:04.993200 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Roles: member,reader Aug 03 05:14:04.994698 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ec7ef948182a457381fd0a686ca298dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ec7ef948182a457381fd0a686ca298dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ec7ef948182a457381fd0a686ca298dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ec7ef948182a457381fd0a686ca298dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:14:04.994698 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant: tempest-DeleteServersTestJSON-966657975 Aug 03 05:14:04.994698 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant-Id: ec7ef948182a457381fd0a686ca298dc Aug 03 05:14:04.994698 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant-Name: tempest-DeleteServersTestJSON-966657975 Aug 03 05:14:04.994698 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User: tempest-DeleteServersTestJSON-966657975-project Aug 03 05:14:04.994698 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Domain-Id: default Aug 03 05:14:04.994698 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Domain-Name: Default Aug 03 05:14:04.994698 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Id: 41541854b74c49a886db2e7bfa867648 Aug 03 05:14:04.994698 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Name: tempest-DeleteServersTestJSON-966657975-project Aug 03 05:14:04.994698 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: method: > Aug 03 05:14:04.994698 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: exception: Instance 13c9e6de-3618-49eb-b497-a7f7dc44c72b could not be found. Aug 03 05:14:04.994698 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: action_args: {'id': '13c9e6de-3618-49eb-b497-a7f7dc44c72b'} Aug 03 05:14:04.995523 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:14:04.995523 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:14:04.995523 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:14:04.995523 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:14:04.995523 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:14:04.995523 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:14:04.995523 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:14:04.995523 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:14:04.995523 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:14:04.995523 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:14:04.995523 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13c9e6de-3618-49eb-b497-a7f7dc44c72b could not be found. Aug 03 05:14:04.995523 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:14:04.995523 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:14:04.995523 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:14:04.995523 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:14:04.995523 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:14:04.995523 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:14:04.995523 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:14:04.995523 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:14:04.995523 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:14:04.996820 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:14:04.996820 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:14:04.996820 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:14:04.996820 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:14:04.996820 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:14:04.996820 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:14:04.996820 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:14:04.996820 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13c9e6de-3618-49eb-b497-a7f7dc44c72b could not be found. Aug 03 05:14:04.996820 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:14:04.996820 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:14:04.996820 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:14:04.996820 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:14:04.996820 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:14:04.996820 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:14:04.996820 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:14:04.996820 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:14:04.996820 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13c9e6de-3618-49eb-b497-a7f7dc44c72b could not be found. Aug 03 05:14:04.996820 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:14:04.998124 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-8e9bad51-f7d2-4c70-8ded-2c72f44dae17 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Returning 404 to user: Instance 13c9e6de-3618-49eb-b497-a7f7dc44c72b could not be found. {{(pid=118332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:14:04.998124 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-8e9bad51-f7d2-4c70-8ded-2c72f44dae17 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] 10.222.0.40 "GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b" status: 404 len: 111 microversion: 2.1 time: 0.037144 Aug 03 05:14:04.998124 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 73/145] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:04 2022] GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:14:05.118709 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-8c312450-8933-4b03-8771-5268a15d0c5f tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:05.120909 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-8c312450-8933-4b03-8771-5268a15d0c5f tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] [instance: 13c9e6de-3618-49eb-b497-a7f7dc44c72b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:05.127786 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8c312450-8933-4b03-8771-5268a15d0c5f tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:05.128237 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8c312450-8933-4b03-8771-5268a15d0c5f tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:05.129009 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8c312450-8933-4b03-8771-5268a15d0c5f tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:05.129448 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8c312450-8933-4b03-8771-5268a15d0c5f tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:05.143936 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.wsgi [None req-8c312450-8933-4b03-8771-5268a15d0c5f tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] HTTP exception thrown: Instance 13c9e6de-3618-49eb-b497-a7f7dc44c72b could not be found. Aug 03 05:14:05.149110 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-8c312450-8933-4b03-8771-5268a15d0c5f tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Request method failure captured: Aug 03 05:14:05.149110 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: request: GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b/os-volume_attachments HTTP/1.1 Aug 03 05:14:05.149110 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Accept: application/json Aug 03 05:14:05.149110 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Accept-Encoding: identity Aug 03 05:14:05.149110 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Connection: close Aug 03 05:14:05.149110 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Content-Length: 0 Aug 03 05:14:05.149110 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Content-Type: application/json Aug 03 05:14:05.149110 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Host: 10.222.0.40 Aug 03 05:14:05.149110 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Openstack-System-Scope: None Aug 03 05:14:05.149110 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: User-Agent: python-urllib3/1.26.10 Aug 03 05:14:05.149110 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Auth-Token: gAAAAABi6gPhwciLyhXYqSRn5tA-Y7cN3wj8IlQlwA-IplbCrPZrkQfyzwX1GlXVvlDL8H9Rpcz7EUrRMW4k2SuGmblz_FDqBjpeZRYvxuTUnvkoNj3-FeFpOPw8cR1J9pVXNm5wirOSXJZomyU1TrVLEDYbA6TB5LqCtl0EX2uVlsPwWPHmvmM Aug 03 05:14:05.149110 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Domain-Id: None Aug 03 05:14:05.149110 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Domain-Name: None Aug 03 05:14:05.149110 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Identity-Status: Confirmed Aug 03 05:14:05.149110 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Is-Admin-Project: True Aug 03 05:14:05.149110 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Domain-Id: default Aug 03 05:14:05.149110 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Domain-Name: Default Aug 03 05:14:05.149110 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Id: ec7ef948182a457381fd0a686ca298dc Aug 03 05:14:05.149110 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Name: tempest-DeleteServersTestJSON-966657975 Aug 03 05:14:05.149110 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Role: member,reader Aug 03 05:14:05.149110 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Roles: member,reader Aug 03 05:14:05.150412 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ec7ef948182a457381fd0a686ca298dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ec7ef948182a457381fd0a686ca298dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ec7ef948182a457381fd0a686ca298dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ec7ef948182a457381fd0a686ca298dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:14:05.150412 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant: tempest-DeleteServersTestJSON-966657975 Aug 03 05:14:05.150412 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant-Id: ec7ef948182a457381fd0a686ca298dc Aug 03 05:14:05.150412 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant-Name: tempest-DeleteServersTestJSON-966657975 Aug 03 05:14:05.150412 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User: tempest-DeleteServersTestJSON-966657975-project Aug 03 05:14:05.150412 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Domain-Id: default Aug 03 05:14:05.150412 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Domain-Name: Default Aug 03 05:14:05.150412 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Id: 41541854b74c49a886db2e7bfa867648 Aug 03 05:14:05.150412 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Name: tempest-DeleteServersTestJSON-966657975-project Aug 03 05:14:05.150412 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: method: > Aug 03 05:14:05.150412 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: exception: Instance 13c9e6de-3618-49eb-b497-a7f7dc44c72b could not be found. Aug 03 05:14:05.150412 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: action_args: {'server_id': '13c9e6de-3618-49eb-b497-a7f7dc44c72b'} Aug 03 05:14:05.151140 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:14:05.151140 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:14:05.151140 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:14:05.151140 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:14:05.151140 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:14:05.151140 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:14:05.151140 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:14:05.151140 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:14:05.151140 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:14:05.151140 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:14:05.151140 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13c9e6de-3618-49eb-b497-a7f7dc44c72b could not be found. Aug 03 05:14:05.151140 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:14:05.151140 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:14:05.151140 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:14:05.151140 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:14:05.151140 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:14:05.151140 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:14:05.151140 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:14:05.151140 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:14:05.151140 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:14:05.152178 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:14:05.152178 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 03 05:14:05.152178 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 05:14:05.152178 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 03 05:14:05.152178 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 05:14:05.152178 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 03 05:14:05.152178 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 03 05:14:05.152178 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:14:05.152178 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:14:05.152178 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13c9e6de-3618-49eb-b497-a7f7dc44c72b could not be found. Aug 03 05:14:05.152178 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:14:05.152178 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:14:05.152178 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:14:05.152178 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:14:05.152178 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:14:05.152178 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:14:05.152178 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:14:05.152178 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:14:05.152178 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13c9e6de-3618-49eb-b497-a7f7dc44c72b could not be found. Aug 03 05:14:05.152178 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:14:05.155071 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-8c312450-8933-4b03-8771-5268a15d0c5f tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Returning 404 to user: Instance 13c9e6de-3618-49eb-b497-a7f7dc44c72b could not be found. {{(pid=118331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:14:05.156028 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-8c312450-8933-4b03-8771-5268a15d0c5f tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] 10.222.0.40 "GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.041588 Aug 03 05:14:05.156739 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 73/146] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Aug 3 05:14:05 2022] GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b/os-volume_attachments => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:14:05.605742 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-17d68911-92e5-4d22-a16a-4704b318f687 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:05.606383 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-17d68911-92e5-4d22-a16a-4704b318f687 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:05.613351 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-17d68911-92e5-4d22-a16a-4704b318f687 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:05.613803 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-17d68911-92e5-4d22-a16a-4704b318f687 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:05.614584 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-17d68911-92e5-4d22-a16a-4704b318f687 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:05.615237 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-17d68911-92e5-4d22-a16a-4704b318f687 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:05.752492 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-17d68911-92e5-4d22-a16a-4704b318f687 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:05.760083 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-17d68911-92e5-4d22-a16a-4704b318f687 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c" status: 200 len: 1521 microversion: 2.1 time: 0.158210 Aug 03 05:14:05.761190 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 74/147] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:05 2022] GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:06.649786 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-8c126745-b03e-4312-933e-1faf0ffc5ea0 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:06.650766 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-8c126745-b03e-4312-933e-1faf0ffc5ea0 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] [instance: 13c9e6de-3618-49eb-b497-a7f7dc44c72b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:06.659462 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8c126745-b03e-4312-933e-1faf0ffc5ea0 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:06.659928 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8c126745-b03e-4312-933e-1faf0ffc5ea0 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:06.662084 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8c126745-b03e-4312-933e-1faf0ffc5ea0 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:06.662084 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8c126745-b03e-4312-933e-1faf0ffc5ea0 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:06.680652 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.wsgi [None req-8c126745-b03e-4312-933e-1faf0ffc5ea0 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] HTTP exception thrown: Instance 13c9e6de-3618-49eb-b497-a7f7dc44c72b could not be found. Aug 03 05:14:06.683058 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-8c126745-b03e-4312-933e-1faf0ffc5ea0 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Request method failure captured: Aug 03 05:14:06.683058 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: request: DELETE /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b HTTP/1.1 Aug 03 05:14:06.683058 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Accept: application/json Aug 03 05:14:06.683058 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Accept-Encoding: identity Aug 03 05:14:06.683058 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Connection: close Aug 03 05:14:06.683058 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Content-Length: 0 Aug 03 05:14:06.683058 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Content-Type: application/json Aug 03 05:14:06.683058 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Host: 10.222.0.40 Aug 03 05:14:06.683058 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Openstack-System-Scope: None Aug 03 05:14:06.683058 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: User-Agent: python-urllib3/1.26.10 Aug 03 05:14:06.683058 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Auth-Token: gAAAAABi6gPhwciLyhXYqSRn5tA-Y7cN3wj8IlQlwA-IplbCrPZrkQfyzwX1GlXVvlDL8H9Rpcz7EUrRMW4k2SuGmblz_FDqBjpeZRYvxuTUnvkoNj3-FeFpOPw8cR1J9pVXNm5wirOSXJZomyU1TrVLEDYbA6TB5LqCtl0EX2uVlsPwWPHmvmM Aug 03 05:14:06.683058 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Domain-Id: None Aug 03 05:14:06.683058 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Domain-Name: None Aug 03 05:14:06.683058 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Identity-Status: Confirmed Aug 03 05:14:06.683058 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Is-Admin-Project: True Aug 03 05:14:06.683058 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Domain-Id: default Aug 03 05:14:06.683058 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Domain-Name: Default Aug 03 05:14:06.683058 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Id: ec7ef948182a457381fd0a686ca298dc Aug 03 05:14:06.683058 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Name: tempest-DeleteServersTestJSON-966657975 Aug 03 05:14:06.683058 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Role: member,reader Aug 03 05:14:06.683058 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Roles: member,reader Aug 03 05:14:06.689980 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ec7ef948182a457381fd0a686ca298dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ec7ef948182a457381fd0a686ca298dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ec7ef948182a457381fd0a686ca298dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ec7ef948182a457381fd0a686ca298dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:14:06.689980 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant: tempest-DeleteServersTestJSON-966657975 Aug 03 05:14:06.689980 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant-Id: ec7ef948182a457381fd0a686ca298dc Aug 03 05:14:06.689980 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant-Name: tempest-DeleteServersTestJSON-966657975 Aug 03 05:14:06.689980 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User: tempest-DeleteServersTestJSON-966657975-project Aug 03 05:14:06.689980 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Domain-Id: default Aug 03 05:14:06.689980 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Domain-Name: Default Aug 03 05:14:06.689980 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Id: 41541854b74c49a886db2e7bfa867648 Aug 03 05:14:06.689980 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Name: tempest-DeleteServersTestJSON-966657975-project Aug 03 05:14:06.689980 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: method: > Aug 03 05:14:06.689980 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: exception: Instance 13c9e6de-3618-49eb-b497-a7f7dc44c72b could not be found. Aug 03 05:14:06.689980 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: action_args: {'id': '13c9e6de-3618-49eb-b497-a7f7dc44c72b'} Aug 03 05:14:06.690711 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:14:06.690711 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:14:06.690711 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:14:06.690711 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:14:06.690711 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:14:06.690711 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:14:06.690711 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:14:06.690711 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:14:06.690711 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:14:06.690711 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:14:06.690711 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13c9e6de-3618-49eb-b497-a7f7dc44c72b could not be found. Aug 03 05:14:06.690711 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:14:06.690711 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:14:06.690711 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:14:06.690711 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:14:06.690711 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:14:06.690711 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:14:06.690711 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:14:06.690711 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:14:06.690711 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:14:06.691796 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:14:06.691796 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 05:14:06.691796 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 05:14:06.691796 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 05:14:06.691796 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 05:14:06.691796 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:14:06.691796 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:14:06.691796 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:14:06.691796 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:14:06.691796 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13c9e6de-3618-49eb-b497-a7f7dc44c72b could not be found. Aug 03 05:14:06.691796 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:14:06.691796 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:14:06.691796 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:14:06.691796 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:14:06.691796 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:14:06.691796 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:14:06.691796 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:14:06.691796 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:14:06.691796 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13c9e6de-3618-49eb-b497-a7f7dc44c72b could not be found. Aug 03 05:14:06.691796 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:14:06.693038 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-b0dc5062-b7c7-49d8-bc55-1091ab023b16 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1679362240", "imageRef": "37d7ad4a-d925-48e6-84af-ec878f19050e", "flavorRef": "452", "networks": [{"uuid": "ba7b8207-d6ca-4229-bc73-fdc35e4a9792"}]}} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:14:06.693547 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-8c126745-b03e-4312-933e-1faf0ffc5ea0 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Returning 404 to user: Instance 13c9e6de-3618-49eb-b497-a7f7dc44c72b could not be found. {{(pid=118331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:14:06.693547 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-8c126745-b03e-4312-933e-1faf0ffc5ea0 tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] 10.222.0.40 "DELETE /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b" status: 404 len: 111 microversion: 2.1 time: 0.043012 Aug 03 05:14:06.693547 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 74/148] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Aug 3 05:14:06 2022] DELETE /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:14:06.697123 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-5be0c16d-fcd5-4708-a3e5-506570a65a6f tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:06.698029 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-5be0c16d-fcd5-4708-a3e5-506570a65a6f tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] [instance: 13c9e6de-3618-49eb-b497-a7f7dc44c72b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:06.704781 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5be0c16d-fcd5-4708-a3e5-506570a65a6f tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:06.705867 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5be0c16d-fcd5-4708-a3e5-506570a65a6f tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:06.706390 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5be0c16d-fcd5-4708-a3e5-506570a65a6f tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:06.706855 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5be0c16d-fcd5-4708-a3e5-506570a65a6f tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:06.720664 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.wsgi [None req-5be0c16d-fcd5-4708-a3e5-506570a65a6f tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] HTTP exception thrown: Instance 13c9e6de-3618-49eb-b497-a7f7dc44c72b could not be found. Aug 03 05:14:06.722485 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-5be0c16d-fcd5-4708-a3e5-506570a65a6f tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Request method failure captured: Aug 03 05:14:06.722485 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: request: GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b HTTP/1.1 Aug 03 05:14:06.722485 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Accept: application/json Aug 03 05:14:06.722485 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Accept-Encoding: identity Aug 03 05:14:06.722485 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Connection: close Aug 03 05:14:06.722485 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Content-Length: 0 Aug 03 05:14:06.722485 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Content-Type: application/json Aug 03 05:14:06.722485 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Host: 10.222.0.40 Aug 03 05:14:06.722485 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Openstack-System-Scope: None Aug 03 05:14:06.722485 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: User-Agent: python-urllib3/1.26.10 Aug 03 05:14:06.722485 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Auth-Token: gAAAAABi6gPhwciLyhXYqSRn5tA-Y7cN3wj8IlQlwA-IplbCrPZrkQfyzwX1GlXVvlDL8H9Rpcz7EUrRMW4k2SuGmblz_FDqBjpeZRYvxuTUnvkoNj3-FeFpOPw8cR1J9pVXNm5wirOSXJZomyU1TrVLEDYbA6TB5LqCtl0EX2uVlsPwWPHmvmM Aug 03 05:14:06.722485 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Domain-Id: None Aug 03 05:14:06.722485 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Domain-Name: None Aug 03 05:14:06.722485 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Identity-Status: Confirmed Aug 03 05:14:06.722485 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Is-Admin-Project: True Aug 03 05:14:06.722485 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Domain-Id: default Aug 03 05:14:06.722485 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Domain-Name: Default Aug 03 05:14:06.722485 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Id: ec7ef948182a457381fd0a686ca298dc Aug 03 05:14:06.722485 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Name: tempest-DeleteServersTestJSON-966657975 Aug 03 05:14:06.722485 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Role: member,reader Aug 03 05:14:06.722485 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Roles: member,reader Aug 03 05:14:06.724126 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ec7ef948182a457381fd0a686ca298dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ec7ef948182a457381fd0a686ca298dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ec7ef948182a457381fd0a686ca298dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ec7ef948182a457381fd0a686ca298dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:14:06.724126 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant: tempest-DeleteServersTestJSON-966657975 Aug 03 05:14:06.724126 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant-Id: ec7ef948182a457381fd0a686ca298dc Aug 03 05:14:06.724126 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant-Name: tempest-DeleteServersTestJSON-966657975 Aug 03 05:14:06.724126 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User: tempest-DeleteServersTestJSON-966657975-project Aug 03 05:14:06.724126 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Domain-Id: default Aug 03 05:14:06.724126 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Domain-Name: Default Aug 03 05:14:06.724126 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Id: 41541854b74c49a886db2e7bfa867648 Aug 03 05:14:06.724126 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Name: tempest-DeleteServersTestJSON-966657975-project Aug 03 05:14:06.724126 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: method: > Aug 03 05:14:06.724126 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: exception: Instance 13c9e6de-3618-49eb-b497-a7f7dc44c72b could not be found. Aug 03 05:14:06.724126 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: action_args: {'id': '13c9e6de-3618-49eb-b497-a7f7dc44c72b'} Aug 03 05:14:06.725001 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:14:06.725001 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:14:06.725001 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:14:06.725001 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:14:06.725001 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:14:06.725001 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:14:06.725001 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:14:06.725001 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:14:06.725001 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:14:06.725001 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:14:06.725001 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13c9e6de-3618-49eb-b497-a7f7dc44c72b could not be found. Aug 03 05:14:06.725001 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:14:06.725001 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:14:06.725001 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:14:06.725001 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:14:06.725001 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:14:06.725001 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:14:06.725001 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:14:06.725001 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:14:06.725001 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:14:06.726483 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:14:06.726483 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:14:06.726483 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:14:06.726483 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:14:06.726483 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:14:06.726483 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:14:06.726483 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:14:06.726483 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13c9e6de-3618-49eb-b497-a7f7dc44c72b could not be found. Aug 03 05:14:06.726483 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:14:06.726483 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:14:06.726483 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:14:06.726483 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:14:06.726483 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:14:06.726483 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:14:06.726483 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:14:06.726483 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:14:06.726483 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13c9e6de-3618-49eb-b497-a7f7dc44c72b could not be found. Aug 03 05:14:06.726483 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:14:06.728814 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-5be0c16d-fcd5-4708-a3e5-506570a65a6f tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] Returning 404 to user: Instance 13c9e6de-3618-49eb-b497-a7f7dc44c72b could not be found. {{(pid=118331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:14:06.728814 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-5be0c16d-fcd5-4708-a3e5-506570a65a6f tempest-DeleteServersTestJSON-966657975 tempest-DeleteServersTestJSON-966657975-project] 10.222.0.40 "GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b" status: 404 len: 111 microversion: 2.1 time: 0.035861 Aug 03 05:14:06.730869 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 75/149] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:06 2022] GET /compute/v2.1/servers/13c9e6de-3618-49eb-b497-a7f7dc44c72b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:14:06.744280 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.network.neutron [None req-b0dc5062-b7c7-49d8-bc55-1091ab023b16 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] validate_networks() for [('ba7b8207-d6ca-4229-bc73-fdc35e4a9792', None, None, None, None, None)] {{(pid=118332) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:14:06.781593 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-417f8269-15f2-4ded-9f33-dc471864d0ae tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:06.782280 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-417f8269-15f2-4ded-9f33-dc471864d0ae tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:06.788852 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-417f8269-15f2-4ded-9f33-dc471864d0ae tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:06.789339 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-417f8269-15f2-4ded-9f33-dc471864d0ae tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:06.790086 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-417f8269-15f2-4ded-9f33-dc471864d0ae tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:06.790528 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-417f8269-15f2-4ded-9f33-dc471864d0ae tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:06.797490 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=100 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:14:07.134832 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-417f8269-15f2-4ded-9f33-dc471864d0ae tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:07.142282 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-417f8269-15f2-4ded-9f33-dc471864d0ae tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c" status: 200 len: 1521 microversion: 2.1 time: 0.364729 Aug 03 05:14:07.142863 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 76/150] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:06 2022] GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c => generated 1521 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:14:07.794943 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.virt.hardware [None req-b0dc5062-b7c7-49d8-bc55-1091ab023b16 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Flavor limits 0:0:0 {{(pid=118332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:14:07.795448 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.virt.hardware [None req-b0dc5062-b7c7-49d8-bc55-1091ab023b16 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Image limits 0:0:0 {{(pid=118332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:14:07.795966 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.virt.hardware [None req-b0dc5062-b7c7-49d8-bc55-1091ab023b16 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Flavor pref 0:0:0 {{(pid=118332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:14:07.796371 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.virt.hardware [None req-b0dc5062-b7c7-49d8-bc55-1091ab023b16 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Image pref 0:0:0 {{(pid=118332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:14:07.796808 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.virt.hardware [None req-b0dc5062-b7c7-49d8-bc55-1091ab023b16 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:14:07.805649 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b0dc5062-b7c7-49d8-bc55-1091ab023b16 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:07.809102 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b0dc5062-b7c7-49d8-bc55-1091ab023b16 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:07.809102 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b0dc5062-b7c7-49d8-bc55-1091ab023b16 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:07.809102 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b0dc5062-b7c7-49d8-bc55-1091ab023b16 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:07.824360 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.quota [None req-b0dc5062-b7c7-49d8-bc55-1091ab023b16 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Getting quotas for project d9b28cfcd2da41528eb3d71199d3b2d9. Resources: {'instances', 'ram', 'cores'} {{(pid=118332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:14:07.828909 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.quota [None req-b0dc5062-b7c7-49d8-bc55-1091ab023b16 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Getting quotas for user 8cbb45074cef4d5082580c4c5130eb9a and project d9b28cfcd2da41528eb3d71199d3b2d9. Resources: {'instances', 'ram', 'cores'} {{(pid=118332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:14:07.840640 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-b0dc5062-b7c7-49d8-bc55-1091ab023b16 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Going to run 1 instances... {{(pid=118332) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:14:07.842948 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-b0dc5062-b7c7-49d8-bc55-1091ab023b16 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] [instance: 97b1b665-e8a1-45eb-8455-613441574fdd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37d7ad4a-d925-48e6-84af-ec878f19050e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:14:07.961076 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-b0dc5062-b7c7-49d8-bc55-1091ab023b16 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.281667 Aug 03 05:14:07.967019 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 75/151] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Aug 3 05:14:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1289 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 05:14:07.977969 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-66890146-20fc-4c02-9c29-965ef43bc96f tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:07.977969 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-66890146-20fc-4c02-9c29-965ef43bc96f tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] [instance: 97b1b665-e8a1-45eb-8455-613441574fdd] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:08.065851 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-66890146-20fc-4c02-9c29-965ef43bc96f tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbb45074cef4d5082580c4c5130eb9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b28cfcd2da41528eb3d71199d3b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:08.075082 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-66890146-20fc-4c02-9c29-965ef43bc96f tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] 10.222.0.40 "GET /compute/v2.1/servers/97b1b665-e8a1-45eb-8455-613441574fdd" status: 200 len: 1214 microversion: 2.1 time: 0.105521 Aug 03 05:14:08.075669 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 77/152] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:07 2022] GET /compute/v2.1/servers/97b1b665-e8a1-45eb-8455-613441574fdd => generated 1214 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:14:08.167509 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-5e90f390-2814-4721-97b3-b670e697300f tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:08.168121 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-5e90f390-2814-4721-97b3-b670e697300f tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:08.174259 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-5e90f390-2814-4721-97b3-b670e697300f tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:08.174711 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-5e90f390-2814-4721-97b3-b670e697300f tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:08.175496 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-5e90f390-2814-4721-97b3-b670e697300f tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:08.175927 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-5e90f390-2814-4721-97b3-b670e697300f tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:08.385372 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-5e90f390-2814-4721-97b3-b670e697300f tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:08.393163 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-5e90f390-2814-4721-97b3-b670e697300f tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c" status: 200 len: 1521 microversion: 2.1 time: 0.229542 Aug 03 05:14:08.393734 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 76/153] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:08 2022] GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:09.098952 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-ce1077d9-9e59-4965-88eb-2c67bf79f18a tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:09.099472 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-ce1077d9-9e59-4965-88eb-2c67bf79f18a tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] [instance: 97b1b665-e8a1-45eb-8455-613441574fdd] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:09.177233 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-ce1077d9-9e59-4965-88eb-2c67bf79f18a tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbb45074cef4d5082580c4c5130eb9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b28cfcd2da41528eb3d71199d3b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:09.184705 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-ce1077d9-9e59-4965-88eb-2c67bf79f18a tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] 10.222.0.40 "GET /compute/v2.1/servers/97b1b665-e8a1-45eb-8455-613441574fdd" status: 200 len: 1214 microversion: 2.1 time: 0.090691 Aug 03 05:14:09.185313 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 78/154] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:09 2022] GET /compute/v2.1/servers/97b1b665-e8a1-45eb-8455-613441574fdd => generated 1214 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:09.419898 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-ab783065-b3b4-4c07-8995-cc498c5ba67d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:09.421142 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-ab783065-b3b4-4c07-8995-cc498c5ba67d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:09.427983 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-ab783065-b3b4-4c07-8995-cc498c5ba67d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:09.428513 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-ab783065-b3b4-4c07-8995-cc498c5ba67d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:09.429359 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-ab783065-b3b4-4c07-8995-cc498c5ba67d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:09.429874 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-ab783065-b3b4-4c07-8995-cc498c5ba67d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:09.860451 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-ab783065-b3b4-4c07-8995-cc498c5ba67d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:09.868776 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-ab783065-b3b4-4c07-8995-cc498c5ba67d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c" status: 200 len: 1521 microversion: 2.1 time: 0.452503 Aug 03 05:14:09.869356 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 77/155] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:09 2022] GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c => generated 1521 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:10.208760 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-d6d195e6-de12-4e2c-aad1-ff822377c2c5 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:10.209385 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-d6d195e6-de12-4e2c-aad1-ff822377c2c5 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] [instance: 97b1b665-e8a1-45eb-8455-613441574fdd] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:10.216326 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d6d195e6-de12-4e2c-aad1-ff822377c2c5 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:10.216787 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d6d195e6-de12-4e2c-aad1-ff822377c2c5 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:10.217572 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d6d195e6-de12-4e2c-aad1-ff822377c2c5 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:10.218020 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d6d195e6-de12-4e2c-aad1-ff822377c2c5 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:10.323984 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-d6d195e6-de12-4e2c-aad1-ff822377c2c5 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbb45074cef4d5082580c4c5130eb9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b28cfcd2da41528eb3d71199d3b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:10.334567 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-d6d195e6-de12-4e2c-aad1-ff822377c2c5 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] 10.222.0.40 "GET /compute/v2.1/servers/97b1b665-e8a1-45eb-8455-613441574fdd" status: 200 len: 1266 microversion: 2.1 time: 0.130039 Aug 03 05:14:10.338818 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 79/156] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:10 2022] GET /compute/v2.1/servers/97b1b665-e8a1-45eb-8455-613441574fdd => generated 1266 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:10.900045 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-11568c46-287b-4010-9dd8-79046d87dd2e tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:10.900045 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-11568c46-287b-4010-9dd8-79046d87dd2e tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:10.908281 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-11568c46-287b-4010-9dd8-79046d87dd2e tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:10.908890 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-11568c46-287b-4010-9dd8-79046d87dd2e tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:10.910155 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-11568c46-287b-4010-9dd8-79046d87dd2e tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:10.910689 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-11568c46-287b-4010-9dd8-79046d87dd2e tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:11.198596 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-11568c46-287b-4010-9dd8-79046d87dd2e tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:11.209156 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-11568c46-287b-4010-9dd8-79046d87dd2e tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c" status: 200 len: 1521 microversion: 2.1 time: 0.323480 Aug 03 05:14:11.223334 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 78/157] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:10 2022] GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c => generated 1521 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:11.357484 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-04d6ee01-fba8-45bd-845f-5cd0d1ee92c2 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:11.359663 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-04d6ee01-fba8-45bd-845f-5cd0d1ee92c2 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] [instance: 97b1b665-e8a1-45eb-8455-613441574fdd] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:11.370528 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-04d6ee01-fba8-45bd-845f-5cd0d1ee92c2 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:11.371690 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-04d6ee01-fba8-45bd-845f-5cd0d1ee92c2 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:11.373041 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-04d6ee01-fba8-45bd-845f-5cd0d1ee92c2 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:11.373858 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-04d6ee01-fba8-45bd-845f-5cd0d1ee92c2 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:11.462684 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-04d6ee01-fba8-45bd-845f-5cd0d1ee92c2 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbb45074cef4d5082580c4c5130eb9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b28cfcd2da41528eb3d71199d3b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:11.470283 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-04d6ee01-fba8-45bd-845f-5cd0d1ee92c2 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] 10.222.0.40 "GET /compute/v2.1/servers/97b1b665-e8a1-45eb-8455-613441574fdd" status: 200 len: 1272 microversion: 2.1 time: 0.117370 Aug 03 05:14:11.470883 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 80/158] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:11 2022] GET /compute/v2.1/servers/97b1b665-e8a1-45eb-8455-613441574fdd => generated 1272 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:12.230244 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-1a5f4dee-d209-4187-98e0-01eef8d9a0ba tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:12.230794 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-1a5f4dee-d209-4187-98e0-01eef8d9a0ba tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:12.237466 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-1a5f4dee-d209-4187-98e0-01eef8d9a0ba tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:12.237919 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-1a5f4dee-d209-4187-98e0-01eef8d9a0ba tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:12.238695 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-1a5f4dee-d209-4187-98e0-01eef8d9a0ba tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:12.239225 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-1a5f4dee-d209-4187-98e0-01eef8d9a0ba tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:12.370139 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-1a5f4dee-d209-4187-98e0-01eef8d9a0ba tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:12.378219 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-1a5f4dee-d209-4187-98e0-01eef8d9a0ba tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c" status: 200 len: 1521 microversion: 2.1 time: 0.151896 Aug 03 05:14:12.386889 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 79/159] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:12 2022] GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:12.492516 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-37f3c66c-3621-42e4-9fe5-bd5f201d75bd tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:12.493120 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-37f3c66c-3621-42e4-9fe5-bd5f201d75bd tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] [instance: 97b1b665-e8a1-45eb-8455-613441574fdd] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:12.500122 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-37f3c66c-3621-42e4-9fe5-bd5f201d75bd tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:12.501227 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-37f3c66c-3621-42e4-9fe5-bd5f201d75bd tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:12.502077 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-37f3c66c-3621-42e4-9fe5-bd5f201d75bd tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:12.502591 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-37f3c66c-3621-42e4-9fe5-bd5f201d75bd tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:12.637941 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-37f3c66c-3621-42e4-9fe5-bd5f201d75bd tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbb45074cef4d5082580c4c5130eb9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b28cfcd2da41528eb3d71199d3b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:12.647366 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-37f3c66c-3621-42e4-9fe5-bd5f201d75bd tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] 10.222.0.40 "GET /compute/v2.1/servers/97b1b665-e8a1-45eb-8455-613441574fdd" status: 200 len: 1314 microversion: 2.1 time: 0.158775 Aug 03 05:14:12.647957 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 81/160] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:12 2022] GET /compute/v2.1/servers/97b1b665-e8a1-45eb-8455-613441574fdd => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:13.399814 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-d111ff9b-0a60-4b13-865e-fa272a7e2fbc tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:13.399814 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-d111ff9b-0a60-4b13-865e-fa272a7e2fbc tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:13.405340 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-d111ff9b-0a60-4b13-865e-fa272a7e2fbc tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:13.405791 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-d111ff9b-0a60-4b13-865e-fa272a7e2fbc tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:13.408327 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-d111ff9b-0a60-4b13-865e-fa272a7e2fbc tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:13.408327 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-d111ff9b-0a60-4b13-865e-fa272a7e2fbc tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:13.540672 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-d111ff9b-0a60-4b13-865e-fa272a7e2fbc tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:13.549309 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-d111ff9b-0a60-4b13-865e-fa272a7e2fbc tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c" status: 200 len: 1521 microversion: 2.1 time: 0.154914 Aug 03 05:14:13.549891 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 80/161] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:13 2022] GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:14:13.667344 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-bda25426-ce46-46ee-839e-3aa87ae90db1 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:13.667954 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-bda25426-ce46-46ee-839e-3aa87ae90db1 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] [instance: 97b1b665-e8a1-45eb-8455-613441574fdd] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:13.674917 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bda25426-ce46-46ee-839e-3aa87ae90db1 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:13.675367 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bda25426-ce46-46ee-839e-3aa87ae90db1 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:13.676119 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bda25426-ce46-46ee-839e-3aa87ae90db1 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:13.676559 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bda25426-ce46-46ee-839e-3aa87ae90db1 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:13.815163 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-bda25426-ce46-46ee-839e-3aa87ae90db1 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbb45074cef4d5082580c4c5130eb9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b28cfcd2da41528eb3d71199d3b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:13.822762 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-bda25426-ce46-46ee-839e-3aa87ae90db1 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] 10.222.0.40 "GET /compute/v2.1/servers/97b1b665-e8a1-45eb-8455-613441574fdd" status: 200 len: 1314 microversion: 2.1 time: 0.159158 Aug 03 05:14:13.823368 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 82/162] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:13 2022] GET /compute/v2.1/servers/97b1b665-e8a1-45eb-8455-613441574fdd => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:14.569676 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-cef21a4c-347a-4f69-9cf2-08e4a4ab2f6e tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:14.580669 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-cef21a4c-347a-4f69-9cf2-08e4a4ab2f6e tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:14.580669 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-cef21a4c-347a-4f69-9cf2-08e4a4ab2f6e tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:14.580669 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-cef21a4c-347a-4f69-9cf2-08e4a4ab2f6e tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:14.580669 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-cef21a4c-347a-4f69-9cf2-08e4a4ab2f6e tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:14.581079 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-cef21a4c-347a-4f69-9cf2-08e4a4ab2f6e tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:14.738440 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-cef21a4c-347a-4f69-9cf2-08e4a4ab2f6e tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:14.746662 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-cef21a4c-347a-4f69-9cf2-08e4a4ab2f6e tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c" status: 200 len: 1521 microversion: 2.1 time: 0.180826 Aug 03 05:14:14.747332 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 81/163] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:14 2022] GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:14.843259 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-a395d6af-2b26-4e8d-b9c1-cf6055de9d48 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:14.843873 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-a395d6af-2b26-4e8d-b9c1-cf6055de9d48 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] [instance: 97b1b665-e8a1-45eb-8455-613441574fdd] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:14.851181 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a395d6af-2b26-4e8d-b9c1-cf6055de9d48 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:14.851860 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a395d6af-2b26-4e8d-b9c1-cf6055de9d48 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:14.852439 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a395d6af-2b26-4e8d-b9c1-cf6055de9d48 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:14.852934 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a395d6af-2b26-4e8d-b9c1-cf6055de9d48 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:15.003699 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-a395d6af-2b26-4e8d-b9c1-cf6055de9d48 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbb45074cef4d5082580c4c5130eb9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b28cfcd2da41528eb3d71199d3b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:15.018583 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-a395d6af-2b26-4e8d-b9c1-cf6055de9d48 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] 10.222.0.40 "GET /compute/v2.1/servers/97b1b665-e8a1-45eb-8455-613441574fdd" status: 200 len: 1314 microversion: 2.1 time: 0.179031 Aug 03 05:14:15.020148 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 83/164] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:14 2022] GET /compute/v2.1/servers/97b1b665-e8a1-45eb-8455-613441574fdd => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:15.208279 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [req-f595076a-38ca-4eac-b70f-362eba8c225b req-7993e7d4-43e7-4b39-9eb7-bd43dc2d3c3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97b1b665-e8a1-45eb-8455-613441574fdd", "tag": "861c9439-6fce-492b-81fb-f040ee1eca77"}]} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:14:15.220359 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-f595076a-38ca-4eac-b70f-362eba8c225b req-7993e7d4-43e7-4b39-9eb7-bd43dc2d3c3f service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:15.221073 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-f595076a-38ca-4eac-b70f-362eba8c225b req-7993e7d4-43e7-4b39-9eb7-bd43dc2d3c3f service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:15.233086 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.compute.server_external_events [req-f595076a-38ca-4eac-b70f-362eba8c225b req-7993e7d4-43e7-4b39-9eb7-bd43dc2d3c3f service nova] Creating event network-changed:861c9439-6fce-492b-81fb-f040ee1eca77 for instance 97b1b665-e8a1-45eb-8455-613441574fdd on hv-cinder-85127 Aug 03 05:14:15.238262 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [req-f595076a-38ca-4eac-b70f-362eba8c225b req-7993e7d4-43e7-4b39-9eb7-bd43dc2d3c3f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036002 Aug 03 05:14:15.238911 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 82/165] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:14:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:14:15.769489 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-62bdf825-203c-49f8-9d6c-fe5d45f2d8cd tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:15.770096 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-62bdf825-203c-49f8-9d6c-fe5d45f2d8cd tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:15.776625 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-62bdf825-203c-49f8-9d6c-fe5d45f2d8cd tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:15.777278 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-62bdf825-203c-49f8-9d6c-fe5d45f2d8cd tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:15.778398 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-62bdf825-203c-49f8-9d6c-fe5d45f2d8cd tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:15.778867 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-62bdf825-203c-49f8-9d6c-fe5d45f2d8cd tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:15.935002 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-62bdf825-203c-49f8-9d6c-fe5d45f2d8cd tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:15.946822 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-62bdf825-203c-49f8-9d6c-fe5d45f2d8cd tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c" status: 200 len: 1521 microversion: 2.1 time: 0.181755 Aug 03 05:14:15.957193 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 84/166] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:15 2022] GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:16.049124 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-60df3fd6-8cf8-46d5-a5d5-3f60ed57c16a tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:16.049836 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-60df3fd6-8cf8-46d5-a5d5-3f60ed57c16a tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] [instance: 97b1b665-e8a1-45eb-8455-613441574fdd] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:16.056510 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-60df3fd6-8cf8-46d5-a5d5-3f60ed57c16a tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:16.057214 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-60df3fd6-8cf8-46d5-a5d5-3f60ed57c16a tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:16.058245 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-60df3fd6-8cf8-46d5-a5d5-3f60ed57c16a tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:16.058686 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-60df3fd6-8cf8-46d5-a5d5-3f60ed57c16a tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:16.196703 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-60df3fd6-8cf8-46d5-a5d5-3f60ed57c16a tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbb45074cef4d5082580c4c5130eb9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b28cfcd2da41528eb3d71199d3b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:16.205152 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-60df3fd6-8cf8-46d5-a5d5-3f60ed57c16a tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] 10.222.0.40 "GET /compute/v2.1/servers/97b1b665-e8a1-45eb-8455-613441574fdd" status: 200 len: 1314 microversion: 2.1 time: 0.164711 Aug 03 05:14:16.205787 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 83/167] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:16 2022] GET /compute/v2.1/servers/97b1b665-e8a1-45eb-8455-613441574fdd => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:16.968248 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-92e8eab2-cffa-4ddd-bd13-faaa1541f55f tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:16.968831 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-92e8eab2-cffa-4ddd-bd13-faaa1541f55f tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:16.977313 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-92e8eab2-cffa-4ddd-bd13-faaa1541f55f tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:16.978036 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-92e8eab2-cffa-4ddd-bd13-faaa1541f55f tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:16.978892 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-92e8eab2-cffa-4ddd-bd13-faaa1541f55f tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:16.979327 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-92e8eab2-cffa-4ddd-bd13-faaa1541f55f tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:17.185238 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-92e8eab2-cffa-4ddd-bd13-faaa1541f55f tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:17.195183 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-92e8eab2-cffa-4ddd-bd13-faaa1541f55f tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c" status: 200 len: 1521 microversion: 2.1 time: 0.231196 Aug 03 05:14:17.195768 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 85/168] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:16 2022] GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:17.228026 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-1c1b1d94-5e5b-4a41-bea1-49856abc6979 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:17.230156 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-1c1b1d94-5e5b-4a41-bea1-49856abc6979 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] [instance: 97b1b665-e8a1-45eb-8455-613441574fdd] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:17.239191 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-1c1b1d94-5e5b-4a41-bea1-49856abc6979 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:17.240450 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-1c1b1d94-5e5b-4a41-bea1-49856abc6979 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:17.242014 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-1c1b1d94-5e5b-4a41-bea1-49856abc6979 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:17.243238 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-1c1b1d94-5e5b-4a41-bea1-49856abc6979 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:17.397008 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-1c1b1d94-5e5b-4a41-bea1-49856abc6979 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbb45074cef4d5082580c4c5130eb9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b28cfcd2da41528eb3d71199d3b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:17.404574 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-1c1b1d94-5e5b-4a41-bea1-49856abc6979 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] 10.222.0.40 "GET /compute/v2.1/servers/97b1b665-e8a1-45eb-8455-613441574fdd" status: 200 len: 1314 microversion: 2.1 time: 0.181412 Aug 03 05:14:17.405161 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 84/169] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:17 2022] GET /compute/v2.1/servers/97b1b665-e8a1-45eb-8455-613441574fdd => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:18.219035 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-fa6b7473-b6c9-4633-bb71-2e18acbbf40d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:18.220677 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-fa6b7473-b6c9-4633-bb71-2e18acbbf40d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:18.232293 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fa6b7473-b6c9-4633-bb71-2e18acbbf40d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:18.237302 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fa6b7473-b6c9-4633-bb71-2e18acbbf40d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:18.238285 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fa6b7473-b6c9-4633-bb71-2e18acbbf40d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:18.239238 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fa6b7473-b6c9-4633-bb71-2e18acbbf40d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:18.380576 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-fa6b7473-b6c9-4633-bb71-2e18acbbf40d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:18.388307 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-fa6b7473-b6c9-4633-bb71-2e18acbbf40d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c" status: 200 len: 1521 microversion: 2.1 time: 0.174326 Aug 03 05:14:18.388874 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 86/170] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:18 2022] GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:18.425706 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-41288bee-a20f-4b3b-a3f7-327c02218330 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:18.426342 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-41288bee-a20f-4b3b-a3f7-327c02218330 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] [instance: 97b1b665-e8a1-45eb-8455-613441574fdd] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:18.428298 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_cell0:SELECT=2 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:14:18.428952 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_cell0:SELECT=6 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:14:18.433847 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-41288bee-a20f-4b3b-a3f7-327c02218330 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:18.434302 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-41288bee-a20f-4b3b-a3f7-327c02218330 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:18.435143 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-41288bee-a20f-4b3b-a3f7-327c02218330 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:18.435574 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-41288bee-a20f-4b3b-a3f7-327c02218330 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:18.588755 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-41288bee-a20f-4b3b-a3f7-327c02218330 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbb45074cef4d5082580c4c5130eb9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b28cfcd2da41528eb3d71199d3b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:18.597880 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-41288bee-a20f-4b3b-a3f7-327c02218330 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] 10.222.0.40 "GET /compute/v2.1/servers/97b1b665-e8a1-45eb-8455-613441574fdd" status: 200 len: 1314 microversion: 2.1 time: 0.176003 Aug 03 05:14:18.598471 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 85/171] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:18 2022] GET /compute/v2.1/servers/97b1b665-e8a1-45eb-8455-613441574fdd => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:14:19.410021 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-54b4cc61-8b02-4c17-bc0d-999e2436b1af tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:19.413330 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-54b4cc61-8b02-4c17-bc0d-999e2436b1af tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:19.413330 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell0:SELECT=4 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:14:19.417791 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-54b4cc61-8b02-4c17-bc0d-999e2436b1af tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:19.418238 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-54b4cc61-8b02-4c17-bc0d-999e2436b1af tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:19.419119 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-54b4cc61-8b02-4c17-bc0d-999e2436b1af tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:19.419566 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-54b4cc61-8b02-4c17-bc0d-999e2436b1af tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:19.559255 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-54b4cc61-8b02-4c17-bc0d-999e2436b1af tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:19.570865 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-54b4cc61-8b02-4c17-bc0d-999e2436b1af tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c" status: 200 len: 1521 microversion: 2.1 time: 0.165097 Aug 03 05:14:19.579081 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 87/172] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:19 2022] GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:19.618602 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-e284a758-0572-467e-9d1e-ed03c67120ef tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:19.619174 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-e284a758-0572-467e-9d1e-ed03c67120ef tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] [instance: 97b1b665-e8a1-45eb-8455-613441574fdd] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:19.625604 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e284a758-0572-467e-9d1e-ed03c67120ef tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:19.626058 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e284a758-0572-467e-9d1e-ed03c67120ef tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:19.626827 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e284a758-0572-467e-9d1e-ed03c67120ef tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:19.627320 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e284a758-0572-467e-9d1e-ed03c67120ef tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:19.766788 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-e284a758-0572-467e-9d1e-ed03c67120ef tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbb45074cef4d5082580c4c5130eb9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b28cfcd2da41528eb3d71199d3b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:19.775077 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-e284a758-0572-467e-9d1e-ed03c67120ef tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] 10.222.0.40 "GET /compute/v2.1/servers/97b1b665-e8a1-45eb-8455-613441574fdd" status: 200 len: 1314 microversion: 2.1 time: 0.160397 Aug 03 05:14:19.775614 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 86/173] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:19 2022] GET /compute/v2.1/servers/97b1b665-e8a1-45eb-8455-613441574fdd => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:20.591981 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-50720dfe-c055-4de5-a224-bde3bb5bd9a9 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:20.592592 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-50720dfe-c055-4de5-a224-bde3bb5bd9a9 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:20.599828 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-50720dfe-c055-4de5-a224-bde3bb5bd9a9 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:20.600286 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-50720dfe-c055-4de5-a224-bde3bb5bd9a9 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:20.603669 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-50720dfe-c055-4de5-a224-bde3bb5bd9a9 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:20.603669 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-50720dfe-c055-4de5-a224-bde3bb5bd9a9 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:20.757387 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-50720dfe-c055-4de5-a224-bde3bb5bd9a9 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:20.764969 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-50720dfe-c055-4de5-a224-bde3bb5bd9a9 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c" status: 200 len: 1501 microversion: 2.1 time: 0.176852 Aug 03 05:14:20.765543 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 88/174] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:20 2022] GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c => generated 1501 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:14:20.786042 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-ab6ba2f3-dabc-43ed-a5e5-d86145f84de8 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:20.786672 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-ab6ba2f3-dabc-43ed-a5e5-d86145f84de8 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 7ee7115a-8a61-415c-a4ba-b53c2aa0c442] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:20.794535 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-ab6ba2f3-dabc-43ed-a5e5-d86145f84de8 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:20.795129 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-ab6ba2f3-dabc-43ed-a5e5-d86145f84de8 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:20.795913 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-ab6ba2f3-dabc-43ed-a5e5-d86145f84de8 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:20.796357 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-ab6ba2f3-dabc-43ed-a5e5-d86145f84de8 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:20.798307 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-615fc865-9236-46fe-a8d6-a5cfae25a893 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:20.799209 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-615fc865-9236-46fe-a8d6-a5cfae25a893 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] [instance: 97b1b665-e8a1-45eb-8455-613441574fdd] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:20.810686 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-615fc865-9236-46fe-a8d6-a5cfae25a893 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:20.811356 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-615fc865-9236-46fe-a8d6-a5cfae25a893 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:20.812232 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-615fc865-9236-46fe-a8d6-a5cfae25a893 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:20.813876 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-615fc865-9236-46fe-a8d6-a5cfae25a893 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:21.054276 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-615fc865-9236-46fe-a8d6-a5cfae25a893 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbb45074cef4d5082580c4c5130eb9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b28cfcd2da41528eb3d71199d3b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:21.064404 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-ab6ba2f3-dabc-43ed-a5e5-d86145f84de8 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:21.073404 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-615fc865-9236-46fe-a8d6-a5cfae25a893 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] 10.222.0.40 "GET /compute/v2.1/servers/97b1b665-e8a1-45eb-8455-613441574fdd" status: 200 len: 1314 microversion: 2.1 time: 0.280525 Aug 03 05:14:21.079267 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-ab6ba2f3-dabc-43ed-a5e5-d86145f84de8 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442" status: 200 len: 1515 microversion: 2.1 time: 0.293269 Aug 03 05:14:21.079522 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 89/175] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:20 2022] GET /compute/v2.1/servers/97b1b665-e8a1-45eb-8455-613441574fdd => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:14:21.088042 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 87/176] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:20 2022] GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442 => generated 1515 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:22.098147 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-0376daa4-53cc-44f0-8e88-ee10984443bc tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:22.098771 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-0376daa4-53cc-44f0-8e88-ee10984443bc tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] [instance: 97b1b665-e8a1-45eb-8455-613441574fdd] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:22.108949 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0376daa4-53cc-44f0-8e88-ee10984443bc tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:22.109450 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0376daa4-53cc-44f0-8e88-ee10984443bc tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:22.110368 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0376daa4-53cc-44f0-8e88-ee10984443bc tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:22.110816 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0376daa4-53cc-44f0-8e88-ee10984443bc tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:22.255457 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-0376daa4-53cc-44f0-8e88-ee10984443bc tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbb45074cef4d5082580c4c5130eb9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b28cfcd2da41528eb3d71199d3b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:22.263542 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-0376daa4-53cc-44f0-8e88-ee10984443bc tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] 10.222.0.40 "GET /compute/v2.1/servers/97b1b665-e8a1-45eb-8455-613441574fdd" status: 200 len: 1314 microversion: 2.1 time: 0.170488 Aug 03 05:14:22.263855 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 90/177] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:22 2022] GET /compute/v2.1/servers/97b1b665-e8a1-45eb-8455-613441574fdd => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:22.672400 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [req-19fd7180-8d01-4f1a-a6ad-a7eaffbdc5f2 req-8d9d4ca4-b75f-4335-bbff-c1ae3237e54b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97b1b665-e8a1-45eb-8455-613441574fdd", "name": "network-vif-plugged", "status": "completed", "tag": "861c9439-6fce-492b-81fb-f040ee1eca77"}]} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:14:22.682808 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-19fd7180-8d01-4f1a-a6ad-a7eaffbdc5f2 req-8d9d4ca4-b75f-4335-bbff-c1ae3237e54b service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:22.683303 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-19fd7180-8d01-4f1a-a6ad-a7eaffbdc5f2 req-8d9d4ca4-b75f-4335-bbff-c1ae3237e54b service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:22.697078 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.compute.server_external_events [req-19fd7180-8d01-4f1a-a6ad-a7eaffbdc5f2 req-8d9d4ca4-b75f-4335-bbff-c1ae3237e54b service nova] Creating event network-vif-plugged:861c9439-6fce-492b-81fb-f040ee1eca77 for instance 97b1b665-e8a1-45eb-8455-613441574fdd on hv-cinder-85127 Aug 03 05:14:22.702388 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [req-19fd7180-8d01-4f1a-a6ad-a7eaffbdc5f2 req-8d9d4ca4-b75f-4335-bbff-c1ae3237e54b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034319 Aug 03 05:14:22.703101 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 88/178] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:14:22.995704 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-f0980b1d-e578-485e-b671-1a75a39c76cd tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:14:22.998362 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-f0980b1d-e578-485e-b671-1a75a39c76cd tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 7ee7115a-8a61-415c-a4ba-b53c2aa0c442] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:23.005128 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f0980b1d-e578-485e-b671-1a75a39c76cd tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:23.005669 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f0980b1d-e578-485e-b671-1a75a39c76cd tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:23.006547 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f0980b1d-e578-485e-b671-1a75a39c76cd tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:23.007093 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f0980b1d-e578-485e-b671-1a75a39c76cd tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:23.034052 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.objects.instance [None req-f0980b1d-e578-485e-b671-1a75a39c76cd tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lazy-loading 'flavor' on Instance uuid 7ee7115a-8a61-415c-a4ba-b53c2aa0c442 {{(pid=118331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:14:23.287528 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-f61cbd8c-ddab-4200-8de3-54767affd187 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:23.288242 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-f61cbd8c-ddab-4200-8de3-54767affd187 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] [instance: 97b1b665-e8a1-45eb-8455-613441574fdd] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:23.294373 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f61cbd8c-ddab-4200-8de3-54767affd187 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:23.294825 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f61cbd8c-ddab-4200-8de3-54767affd187 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:23.301067 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f61cbd8c-ddab-4200-8de3-54767affd187 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:23.301640 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f61cbd8c-ddab-4200-8de3-54767affd187 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:23.320509 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_cell1:SELECT=100 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:14:23.415830 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-f0980b1d-e578-485e-b671-1a75a39c76cd tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "POST /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442/action" status: 200 len: 32 microversion: 2.1 time: 0.421004 Aug 03 05:14:23.415830 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 91/179] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Aug 3 05:14:22 2022] POST /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442/action => generated 32 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 03 05:14:23.430288 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-799e645f-414c-4281-90e9-c8e4ee689d28 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:23.431957 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-799e645f-414c-4281-90e9-c8e4ee689d28 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 7ee7115a-8a61-415c-a4ba-b53c2aa0c442] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:23.439758 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-799e645f-414c-4281-90e9-c8e4ee689d28 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:23.444556 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-799e645f-414c-4281-90e9-c8e4ee689d28 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:23.444556 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-799e645f-414c-4281-90e9-c8e4ee689d28 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:23.444556 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-799e645f-414c-4281-90e9-c8e4ee689d28 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:23.445885 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-f61cbd8c-ddab-4200-8de3-54767affd187 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbb45074cef4d5082580c4c5130eb9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b28cfcd2da41528eb3d71199d3b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:23.453493 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-f61cbd8c-ddab-4200-8de3-54767affd187 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] 10.222.0.40 "GET /compute/v2.1/servers/97b1b665-e8a1-45eb-8455-613441574fdd" status: 200 len: 1314 microversion: 2.1 time: 0.171122 Aug 03 05:14:23.454062 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 89/180] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:23 2022] GET /compute/v2.1/servers/97b1b665-e8a1-45eb-8455-613441574fdd => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:14:23.635681 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-799e645f-414c-4281-90e9-c8e4ee689d28 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:23.643828 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:14:23.646831 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-799e645f-414c-4281-90e9-c8e4ee689d28 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442" status: 200 len: 1521 microversion: 2.1 time: 0.221110 Aug 03 05:14:23.647772 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 92/181] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:23 2022] GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:14:24.474253 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-257ee392-1627-4c06-aaff-926e403e2428 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:24.474889 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-257ee392-1627-4c06-aaff-926e403e2428 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] [instance: 97b1b665-e8a1-45eb-8455-613441574fdd] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:24.482122 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-257ee392-1627-4c06-aaff-926e403e2428 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:24.482590 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-257ee392-1627-4c06-aaff-926e403e2428 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:24.483389 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-257ee392-1627-4c06-aaff-926e403e2428 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:24.483989 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-257ee392-1627-4c06-aaff-926e403e2428 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:24.637418 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-257ee392-1627-4c06-aaff-926e403e2428 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbb45074cef4d5082580c4c5130eb9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b28cfcd2da41528eb3d71199d3b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:24.646543 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-257ee392-1627-4c06-aaff-926e403e2428 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] 10.222.0.40 "GET /compute/v2.1/servers/97b1b665-e8a1-45eb-8455-613441574fdd" status: 200 len: 1314 microversion: 2.1 time: 0.176750 Aug 03 05:14:24.647191 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 90/182] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:24 2022] GET /compute/v2.1/servers/97b1b665-e8a1-45eb-8455-613441574fdd => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:24.669546 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-4886ca45-cf10-4cb1-bdbf-90ddc384b0bd tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:24.670164 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-4886ca45-cf10-4cb1-bdbf-90ddc384b0bd tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 7ee7115a-8a61-415c-a4ba-b53c2aa0c442] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:24.677107 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4886ca45-cf10-4cb1-bdbf-90ddc384b0bd tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:24.677565 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4886ca45-cf10-4cb1-bdbf-90ddc384b0bd tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:24.678341 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4886ca45-cf10-4cb1-bdbf-90ddc384b0bd tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:24.678792 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4886ca45-cf10-4cb1-bdbf-90ddc384b0bd tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:24.819701 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-4886ca45-cf10-4cb1-bdbf-90ddc384b0bd tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:24.828044 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-4886ca45-cf10-4cb1-bdbf-90ddc384b0bd tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442" status: 200 len: 1521 microversion: 2.1 time: 0.163052 Aug 03 05:14:24.828737 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 93/183] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:24 2022] GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:25.667393 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-82b61062-a4f5-4849-8518-6366cdc3bbc4 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:25.669063 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-82b61062-a4f5-4849-8518-6366cdc3bbc4 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] [instance: 97b1b665-e8a1-45eb-8455-613441574fdd] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:25.675455 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-82b61062-a4f5-4849-8518-6366cdc3bbc4 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:25.679063 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-82b61062-a4f5-4849-8518-6366cdc3bbc4 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:25.692281 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-82b61062-a4f5-4849-8518-6366cdc3bbc4 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:25.692281 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-82b61062-a4f5-4849-8518-6366cdc3bbc4 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:25.849415 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-b075999a-a498-481c-aefe-cfa49eb4015c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:25.850148 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-b075999a-a498-481c-aefe-cfa49eb4015c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 7ee7115a-8a61-415c-a4ba-b53c2aa0c442] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:25.856455 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-82b61062-a4f5-4849-8518-6366cdc3bbc4 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbb45074cef4d5082580c4c5130eb9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b28cfcd2da41528eb3d71199d3b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:25.859363 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b075999a-a498-481c-aefe-cfa49eb4015c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:25.859823 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b075999a-a498-481c-aefe-cfa49eb4015c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:25.860608 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b075999a-a498-481c-aefe-cfa49eb4015c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:25.863500 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b075999a-a498-481c-aefe-cfa49eb4015c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:25.870256 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-82b61062-a4f5-4849-8518-6366cdc3bbc4 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] 10.222.0.40 "GET /compute/v2.1/servers/97b1b665-e8a1-45eb-8455-613441574fdd" status: 200 len: 1499 microversion: 2.1 time: 0.203474 Aug 03 05:14:25.871381 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 91/184] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:25 2022] GET /compute/v2.1/servers/97b1b665-e8a1-45eb-8455-613441574fdd => generated 1499 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:26.028131 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-b075999a-a498-481c-aefe-cfa49eb4015c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:26.036526 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-b075999a-a498-481c-aefe-cfa49eb4015c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442" status: 200 len: 1521 microversion: 2.1 time: 0.191204 Aug 03 05:14:26.037134 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 94/185] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:25 2022] GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:27.047902 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-446157fd-4da7-4a24-8134-c20d87692758 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:27.047902 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-446157fd-4da7-4a24-8134-c20d87692758 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] [instance: 97b1b665-e8a1-45eb-8455-613441574fdd] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:27.047902 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-446157fd-4da7-4a24-8134-c20d87692758 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:27.047902 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-446157fd-4da7-4a24-8134-c20d87692758 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:27.048557 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-446157fd-4da7-4a24-8134-c20d87692758 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:27.048557 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-446157fd-4da7-4a24-8134-c20d87692758 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:27.061925 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-3be28d20-a515-4a4a-ab84-df84bdb2ba44 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:27.071749 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-446157fd-4da7-4a24-8134-c20d87692758 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] [instance: 97b1b665-e8a1-45eb-8455-613441574fdd] Going to try to terminate instance {{(pid=118332) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:14:27.072751 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-3be28d20-a515-4a4a-ab84-df84bdb2ba44 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 7ee7115a-8a61-415c-a4ba-b53c2aa0c442] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:27.092880 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_api:SELECT=66 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:14:27.095369 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3be28d20-a515-4a4a-ab84-df84bdb2ba44 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:27.096172 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3be28d20-a515-4a4a-ab84-df84bdb2ba44 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:27.097164 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3be28d20-a515-4a4a-ab84-df84bdb2ba44 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:27.097795 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3be28d20-a515-4a4a-ab84-df84bdb2ba44 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:27.311674 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-3be28d20-a515-4a4a-ab84-df84bdb2ba44 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:27.321141 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-3be28d20-a515-4a4a-ab84-df84bdb2ba44 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442" status: 200 len: 1521 microversion: 2.1 time: 0.266493 Aug 03 05:14:27.335330 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 95/186] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:27 2022] GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442 => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:27.418417 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-446157fd-4da7-4a24-8134-c20d87692758 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] 10.222.0.40 "DELETE /compute/v2.1/servers/97b1b665-e8a1-45eb-8455-613441574fdd" status: 204 len: 0 microversion: 2.1 time: 0.385690 Aug 03 05:14:27.423217 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 92/187] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Aug 3 05:14:27 2022] DELETE /compute/v2.1/servers/97b1b665-e8a1-45eb-8455-613441574fdd => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:14:27.436746 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-47b4c0fd-d0aa-4ab0-b510-e21194a8ae7c tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:27.437836 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-47b4c0fd-d0aa-4ab0-b510-e21194a8ae7c tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] [instance: 97b1b665-e8a1-45eb-8455-613441574fdd] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:27.466753 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-47b4c0fd-d0aa-4ab0-b510-e21194a8ae7c tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:27.467547 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-47b4c0fd-d0aa-4ab0-b510-e21194a8ae7c tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:27.469098 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-47b4c0fd-d0aa-4ab0-b510-e21194a8ae7c tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:27.469760 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-47b4c0fd-d0aa-4ab0-b510-e21194a8ae7c tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:27.615671 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-47b4c0fd-d0aa-4ab0-b510-e21194a8ae7c tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbb45074cef4d5082580c4c5130eb9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b28cfcd2da41528eb3d71199d3b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:27.628307 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-47b4c0fd-d0aa-4ab0-b510-e21194a8ae7c tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] 10.222.0.40 "GET /compute/v2.1/servers/97b1b665-e8a1-45eb-8455-613441574fdd" status: 200 len: 1505 microversion: 2.1 time: 0.197660 Aug 03 05:14:27.629348 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 96/188] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:27 2022] GET /compute/v2.1/servers/97b1b665-e8a1-45eb-8455-613441574fdd => generated 1505 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:28.343255 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-f4971f22-c7a4-4866-b67c-1e5271793379 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:28.343922 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-f4971f22-c7a4-4866-b67c-1e5271793379 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 7ee7115a-8a61-415c-a4ba-b53c2aa0c442] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:28.350463 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f4971f22-c7a4-4866-b67c-1e5271793379 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:28.355425 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f4971f22-c7a4-4866-b67c-1e5271793379 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:28.355425 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f4971f22-c7a4-4866-b67c-1e5271793379 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:28.355425 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f4971f22-c7a4-4866-b67c-1e5271793379 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:28.555595 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-f4971f22-c7a4-4866-b67c-1e5271793379 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:28.564084 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-f4971f22-c7a4-4866-b67c-1e5271793379 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442" status: 200 len: 1521 microversion: 2.1 time: 0.225096 Aug 03 05:14:28.564756 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 93/189] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:28 2022] GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442 => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:28.650894 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-f3be67a3-8cf7-4fca-8b45-dc2552dd63b4 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:28.651540 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-f3be67a3-8cf7-4fca-8b45-dc2552dd63b4 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] [instance: 97b1b665-e8a1-45eb-8455-613441574fdd] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:28.658051 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f3be67a3-8cf7-4fca-8b45-dc2552dd63b4 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:28.658503 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f3be67a3-8cf7-4fca-8b45-dc2552dd63b4 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:28.659302 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f3be67a3-8cf7-4fca-8b45-dc2552dd63b4 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:28.659925 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f3be67a3-8cf7-4fca-8b45-dc2552dd63b4 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:28.815077 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-f3be67a3-8cf7-4fca-8b45-dc2552dd63b4 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbb45074cef4d5082580c4c5130eb9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b28cfcd2da41528eb3d71199d3b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:28.822721 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-f3be67a3-8cf7-4fca-8b45-dc2552dd63b4 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] 10.222.0.40 "GET /compute/v2.1/servers/97b1b665-e8a1-45eb-8455-613441574fdd" status: 200 len: 1505 microversion: 2.1 time: 0.175664 Aug 03 05:14:28.823331 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 97/190] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:28 2022] GET /compute/v2.1/servers/97b1b665-e8a1-45eb-8455-613441574fdd => generated 1505 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:29.585230 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-dd66aa9e-3b18-4777-8e71-b5b8187677e2 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:29.585991 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-dd66aa9e-3b18-4777-8e71-b5b8187677e2 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 7ee7115a-8a61-415c-a4ba-b53c2aa0c442] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:29.589551 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:14:29.594358 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-dd66aa9e-3b18-4777-8e71-b5b8187677e2 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:29.594937 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-dd66aa9e-3b18-4777-8e71-b5b8187677e2 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:29.596111 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-dd66aa9e-3b18-4777-8e71-b5b8187677e2 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:29.596795 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-dd66aa9e-3b18-4777-8e71-b5b8187677e2 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:29.739165 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-dd66aa9e-3b18-4777-8e71-b5b8187677e2 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:29.746796 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-dd66aa9e-3b18-4777-8e71-b5b8187677e2 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442" status: 200 len: 1521 microversion: 2.1 time: 0.165397 Aug 03 05:14:29.747386 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 94/191] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:29 2022] GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:14:29.845317 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-f2d3b406-16be-44c2-83b9-efc29b962f5f tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:29.846562 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-f2d3b406-16be-44c2-83b9-efc29b962f5f tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] [instance: 97b1b665-e8a1-45eb-8455-613441574fdd] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:29.869697 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f2d3b406-16be-44c2-83b9-efc29b962f5f tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:29.870152 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f2d3b406-16be-44c2-83b9-efc29b962f5f tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:29.870952 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f2d3b406-16be-44c2-83b9-efc29b962f5f tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:29.871392 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f2d3b406-16be-44c2-83b9-efc29b962f5f tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:30.240525 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-f2d3b406-16be-44c2-83b9-efc29b962f5f tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbb45074cef4d5082580c4c5130eb9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b28cfcd2da41528eb3d71199d3b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:30.248741 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-f2d3b406-16be-44c2-83b9-efc29b962f5f tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] 10.222.0.40 "GET /compute/v2.1/servers/97b1b665-e8a1-45eb-8455-613441574fdd" status: 200 len: 1505 microversion: 2.1 time: 0.408487 Aug 03 05:14:30.249426 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 98/192] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:29 2022] GET /compute/v2.1/servers/97b1b665-e8a1-45eb-8455-613441574fdd => generated 1505 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:30.768145 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-31599415-3d89-4f20-80c2-d75e1e1a6216 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:30.768756 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-31599415-3d89-4f20-80c2-d75e1e1a6216 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 7ee7115a-8a61-415c-a4ba-b53c2aa0c442] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:30.774974 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-31599415-3d89-4f20-80c2-d75e1e1a6216 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:30.775431 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-31599415-3d89-4f20-80c2-d75e1e1a6216 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:30.776195 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-31599415-3d89-4f20-80c2-d75e1e1a6216 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:30.776636 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-31599415-3d89-4f20-80c2-d75e1e1a6216 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:30.906282 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-31599415-3d89-4f20-80c2-d75e1e1a6216 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:30.914215 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-31599415-3d89-4f20-80c2-d75e1e1a6216 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442" status: 200 len: 1521 microversion: 2.1 time: 0.150824 Aug 03 05:14:30.914809 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 95/193] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:30 2022] GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:31.280374 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-1e1fe4d1-c230-4266-8634-1ec8e586f72b tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:31.295116 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-1e1fe4d1-c230-4266-8634-1ec8e586f72b tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] [instance: 97b1b665-e8a1-45eb-8455-613441574fdd] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:31.298561 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1e1fe4d1-c230-4266-8634-1ec8e586f72b tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:31.299232 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1e1fe4d1-c230-4266-8634-1ec8e586f72b tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:31.305956 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1e1fe4d1-c230-4266-8634-1ec8e586f72b tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:31.305956 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1e1fe4d1-c230-4266-8634-1ec8e586f72b tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:31.461023 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-1e1fe4d1-c230-4266-8634-1ec8e586f72b tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbb45074cef4d5082580c4c5130eb9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b28cfcd2da41528eb3d71199d3b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:31.469276 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-1e1fe4d1-c230-4266-8634-1ec8e586f72b tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] 10.222.0.40 "GET /compute/v2.1/servers/97b1b665-e8a1-45eb-8455-613441574fdd" status: 200 len: 1505 microversion: 2.1 time: 0.194396 Aug 03 05:14:31.469850 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 99/194] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:31 2022] GET /compute/v2.1/servers/97b1b665-e8a1-45eb-8455-613441574fdd => generated 1505 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:31.936123 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-8d3c367f-e04f-4f9f-92ff-d9f9e5d6790a tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:31.937894 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-8d3c367f-e04f-4f9f-92ff-d9f9e5d6790a tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 7ee7115a-8a61-415c-a4ba-b53c2aa0c442] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:31.944256 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-8d3c367f-e04f-4f9f-92ff-d9f9e5d6790a tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:31.944707 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-8d3c367f-e04f-4f9f-92ff-d9f9e5d6790a tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:31.945514 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-8d3c367f-e04f-4f9f-92ff-d9f9e5d6790a tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:31.945956 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-8d3c367f-e04f-4f9f-92ff-d9f9e5d6790a tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:32.153360 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-8d3c367f-e04f-4f9f-92ff-d9f9e5d6790a tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:32.161667 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-8d3c367f-e04f-4f9f-92ff-d9f9e5d6790a tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442" status: 200 len: 1521 microversion: 2.1 time: 0.229975 Aug 03 05:14:32.162243 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 96/195] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:31 2022] GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442 => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:32.368648 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-d4315fea-2b3c-422a-96c3-22f438401dec req-d37d3035-cbda-4c66-8797-48922ae895c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97b1b665-e8a1-45eb-8455-613441574fdd", "name": "network-vif-deleted", "tag": "861c9439-6fce-492b-81fb-f040ee1eca77"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:14:32.385892 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-d4315fea-2b3c-422a-96c3-22f438401dec req-d37d3035-cbda-4c66-8797-48922ae895c1 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:32.386446 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-d4315fea-2b3c-422a-96c3-22f438401dec req-d37d3035-cbda-4c66-8797-48922ae895c1 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:32.408086 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-d4315fea-2b3c-422a-96c3-22f438401dec req-d37d3035-cbda-4c66-8797-48922ae895c1 service nova] Creating event network-vif-deleted:861c9439-6fce-492b-81fb-f040ee1eca77 for instance 97b1b665-e8a1-45eb-8455-613441574fdd on hv-cinder-85127 Aug 03 05:14:32.408086 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-d4315fea-2b3c-422a-96c3-22f438401dec req-d37d3035-cbda-4c66-8797-48922ae895c1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038400 Aug 03 05:14:32.408086 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 100/196] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:14:32.490650 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-83f2a1c7-800c-46af-9f21-6beff3dfa6ce tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:32.491299 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-83f2a1c7-800c-46af-9f21-6beff3dfa6ce tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] [instance: 97b1b665-e8a1-45eb-8455-613441574fdd] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:32.497238 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-83f2a1c7-800c-46af-9f21-6beff3dfa6ce tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:32.497691 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-83f2a1c7-800c-46af-9f21-6beff3dfa6ce tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:32.498452 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-83f2a1c7-800c-46af-9f21-6beff3dfa6ce tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:32.498920 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-83f2a1c7-800c-46af-9f21-6beff3dfa6ce tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:32.568798 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-83f2a1c7-800c-46af-9f21-6beff3dfa6ce tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbb45074cef4d5082580c4c5130eb9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b28cfcd2da41528eb3d71199d3b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:32.576832 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-83f2a1c7-800c-46af-9f21-6beff3dfa6ce tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] 10.222.0.40 "GET /compute/v2.1/servers/97b1b665-e8a1-45eb-8455-613441574fdd" status: 200 len: 1463 microversion: 2.1 time: 0.089920 Aug 03 05:14:32.577428 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 97/197] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:32 2022] GET /compute/v2.1/servers/97b1b665-e8a1-45eb-8455-613441574fdd => generated 1463 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:33.184250 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-06828abd-e447-4b09-bb47-c824e6811531 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:33.184925 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-06828abd-e447-4b09-bb47-c824e6811531 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 7ee7115a-8a61-415c-a4ba-b53c2aa0c442] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:33.191198 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-06828abd-e447-4b09-bb47-c824e6811531 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:33.195180 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-06828abd-e447-4b09-bb47-c824e6811531 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:33.195180 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-06828abd-e447-4b09-bb47-c824e6811531 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:33.195180 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-06828abd-e447-4b09-bb47-c824e6811531 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:33.324789 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-06828abd-e447-4b09-bb47-c824e6811531 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:33.333232 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-06828abd-e447-4b09-bb47-c824e6811531 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442" status: 200 len: 1521 microversion: 2.1 time: 0.153178 Aug 03 05:14:33.333807 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 101/198] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:33 2022] GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:33.601843 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-b6330add-cda5-4e7f-997a-2ec427659c60 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:33.603395 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-b6330add-cda5-4e7f-997a-2ec427659c60 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] [instance: 97b1b665-e8a1-45eb-8455-613441574fdd] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:33.614527 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b6330add-cda5-4e7f-997a-2ec427659c60 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:33.614527 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b6330add-cda5-4e7f-997a-2ec427659c60 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:33.614527 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b6330add-cda5-4e7f-997a-2ec427659c60 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:33.614527 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b6330add-cda5-4e7f-997a-2ec427659c60 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:33.628628 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.wsgi [None req-b6330add-cda5-4e7f-997a-2ec427659c60 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] HTTP exception thrown: Instance 97b1b665-e8a1-45eb-8455-613441574fdd could not be found. Aug 03 05:14:33.630286 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-b6330add-cda5-4e7f-997a-2ec427659c60 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Request method failure captured: Aug 03 05:14:33.630286 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: request: GET /compute/v2.1/servers/97b1b665-e8a1-45eb-8455-613441574fdd HTTP/1.1 Aug 03 05:14:33.630286 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Accept: application/json Aug 03 05:14:33.630286 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Accept-Encoding: identity Aug 03 05:14:33.630286 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Connection: close Aug 03 05:14:33.630286 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Content-Length: 0 Aug 03 05:14:33.630286 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Content-Type: application/json Aug 03 05:14:33.630286 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Host: 10.222.0.40 Aug 03 05:14:33.630286 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Openstack-System-Scope: None Aug 03 05:14:33.630286 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: User-Agent: python-urllib3/1.26.10 Aug 03 05:14:33.630286 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Auth-Token: gAAAAABi6gQcTGOHWy2MPmIrCIoE8ta_1b1Cznzh4obwkGMOZRLXyuy3iACGP2rq4ex0_dlV_cJzhK_R4EFisXJhDCCiTx_8PFdlvgJ_KmZ8LydOs7QkTnxh8l5TLTa9clJEArq0hX8kpNGOIYMBupCymsdMH_3MjEoMydVOctkELZ0R5KuCg9I Aug 03 05:14:33.630286 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Domain-Id: None Aug 03 05:14:33.630286 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Domain-Name: None Aug 03 05:14:33.630286 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Identity-Status: Confirmed Aug 03 05:14:33.630286 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Is-Admin-Project: True Aug 03 05:14:33.630286 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Domain-Id: default Aug 03 05:14:33.630286 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Domain-Name: Default Aug 03 05:14:33.630286 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Id: d9b28cfcd2da41528eb3d71199d3b2d9 Aug 03 05:14:33.630286 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Name: tempest-VolumesActionsTest-314457804 Aug 03 05:14:33.630286 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Role: member,reader Aug 03 05:14:33.630286 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Roles: member,reader Aug 03 05:14:33.631770 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d9b28cfcd2da41528eb3d71199d3b2d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d9b28cfcd2da41528eb3d71199d3b2d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d9b28cfcd2da41528eb3d71199d3b2d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d9b28cfcd2da41528eb3d71199d3b2d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:14:33.631770 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant: tempest-VolumesActionsTest-314457804 Aug 03 05:14:33.631770 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant-Id: d9b28cfcd2da41528eb3d71199d3b2d9 Aug 03 05:14:33.631770 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant-Name: tempest-VolumesActionsTest-314457804 Aug 03 05:14:33.631770 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User: tempest-VolumesActionsTest-314457804-project Aug 03 05:14:33.631770 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Domain-Id: default Aug 03 05:14:33.631770 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Domain-Name: Default Aug 03 05:14:33.631770 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Id: 8cbb45074cef4d5082580c4c5130eb9a Aug 03 05:14:33.631770 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Name: tempest-VolumesActionsTest-314457804-project Aug 03 05:14:33.631770 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: method: > Aug 03 05:14:33.631770 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: exception: Instance 97b1b665-e8a1-45eb-8455-613441574fdd could not be found. Aug 03 05:14:33.631770 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: action_args: {'id': '97b1b665-e8a1-45eb-8455-613441574fdd'} Aug 03 05:14:33.632559 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:14:33.632559 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:14:33.632559 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:14:33.632559 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:14:33.632559 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:14:33.632559 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:14:33.632559 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:14:33.632559 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:14:33.632559 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:14:33.632559 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:14:33.632559 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97b1b665-e8a1-45eb-8455-613441574fdd could not be found. Aug 03 05:14:33.632559 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:14:33.632559 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:14:33.632559 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:14:33.632559 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:14:33.632559 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:14:33.632559 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:14:33.632559 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:14:33.632559 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:14:33.632559 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:14:33.634549 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:14:33.634549 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:14:33.634549 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:14:33.634549 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:14:33.634549 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:14:33.634549 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:14:33.634549 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:14:33.634549 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97b1b665-e8a1-45eb-8455-613441574fdd could not be found. Aug 03 05:14:33.634549 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:14:33.634549 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:14:33.634549 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:14:33.634549 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:14:33.634549 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:14:33.634549 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:14:33.634549 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:14:33.634549 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:14:33.634549 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97b1b665-e8a1-45eb-8455-613441574fdd could not be found. Aug 03 05:14:33.634549 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:14:33.637707 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-b6330add-cda5-4e7f-997a-2ec427659c60 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Returning 404 to user: Instance 97b1b665-e8a1-45eb-8455-613441574fdd could not be found. {{(pid=118332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:14:33.637707 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-b6330add-cda5-4e7f-997a-2ec427659c60 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] 10.222.0.40 "GET /compute/v2.1/servers/97b1b665-e8a1-45eb-8455-613441574fdd" status: 404 len: 111 microversion: 2.1 time: 0.042172 Aug 03 05:14:33.637707 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 98/199] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:33 2022] GET /compute/v2.1/servers/97b1b665-e8a1-45eb-8455-613441574fdd => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:14:33.747511 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-ddb9acf2-6d1d-47fb-8459-f2691c6ea338 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1086695319", "imageRef": "37d7ad4a-d925-48e6-84af-ec878f19050e", "flavorRef": "452", "networks": [{"uuid": "ba7b8207-d6ca-4229-bc73-fdc35e4a9792"}]}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:14:33.802204 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.network.neutron [None req-ddb9acf2-6d1d-47fb-8459-f2691c6ea338 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] validate_networks() for [('ba7b8207-d6ca-4229-bc73-fdc35e4a9792', None, None, None, None, None)] {{(pid=118331) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:14:34.167142 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-ddb9acf2-6d1d-47fb-8459-f2691c6ea338 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Flavor limits 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:14:34.167573 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-ddb9acf2-6d1d-47fb-8459-f2691c6ea338 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Image limits 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:14:34.168051 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-ddb9acf2-6d1d-47fb-8459-f2691c6ea338 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Flavor pref 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:14:34.168461 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-ddb9acf2-6d1d-47fb-8459-f2691c6ea338 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Image pref 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:14:34.168895 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-ddb9acf2-6d1d-47fb-8459-f2691c6ea338 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:14:34.179019 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ddb9acf2-6d1d-47fb-8459-f2691c6ea338 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:34.179683 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ddb9acf2-6d1d-47fb-8459-f2691c6ea338 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:34.180729 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ddb9acf2-6d1d-47fb-8459-f2691c6ea338 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:34.181316 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ddb9acf2-6d1d-47fb-8459-f2691c6ea338 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:34.201487 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-ddb9acf2-6d1d-47fb-8459-f2691c6ea338 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Getting quotas for project d9b28cfcd2da41528eb3d71199d3b2d9. Resources: {'instances', 'ram', 'cores'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:14:34.208099 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-ddb9acf2-6d1d-47fb-8459-f2691c6ea338 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Getting quotas for user 8cbb45074cef4d5082580c4c5130eb9a and project d9b28cfcd2da41528eb3d71199d3b2d9. Resources: {'instances', 'ram', 'cores'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:14:34.221022 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-ddb9acf2-6d1d-47fb-8459-f2691c6ea338 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Going to run 1 instances... {{(pid=118331) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:14:34.223783 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-ddb9acf2-6d1d-47fb-8459-f2691c6ea338 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] [instance: 49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37d7ad4a-d925-48e6-84af-ec878f19050e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:14:34.359936 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-ddb9acf2-6d1d-47fb-8459-f2691c6ea338 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.616157 Aug 03 05:14:34.361944 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-7de1b1e7-4f82-4ab2-a162-0f35927fdf31 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:34.362783 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-7de1b1e7-4f82-4ab2-a162-0f35927fdf31 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 7ee7115a-8a61-415c-a4ba-b53c2aa0c442] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:34.368859 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 102/200] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Aug 3 05:14:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 05:14:34.371699 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-7de1b1e7-4f82-4ab2-a162-0f35927fdf31 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:34.372782 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-7de1b1e7-4f82-4ab2-a162-0f35927fdf31 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:34.374031 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-7de1b1e7-4f82-4ab2-a162-0f35927fdf31 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:34.374673 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-7de1b1e7-4f82-4ab2-a162-0f35927fdf31 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:34.376181 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-50d9447c-eb6e-42d8-b1ff-650098be06fa tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:34.379165 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-50d9447c-eb6e-42d8-b1ff-650098be06fa tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] [instance: 49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:34.498405 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-50d9447c-eb6e-42d8-b1ff-650098be06fa tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbb45074cef4d5082580c4c5130eb9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b28cfcd2da41528eb3d71199d3b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:34.506145 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-50d9447c-eb6e-42d8-b1ff-650098be06fa tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] 10.222.0.40 "GET /compute/v2.1/servers/49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3" status: 200 len: 1214 microversion: 2.1 time: 0.136176 Aug 03 05:14:34.512018 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 103/201] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:34 2022] GET /compute/v2.1/servers/49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3 => generated 1214 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:34.604187 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-7de1b1e7-4f82-4ab2-a162-0f35927fdf31 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:34.613707 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-7de1b1e7-4f82-4ab2-a162-0f35927fdf31 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442" status: 200 len: 1521 microversion: 2.1 time: 0.256862 Aug 03 05:14:34.627426 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 99/202] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:34 2022] GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442 => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:35.533188 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-6b7a1ffe-ef72-42aa-be97-b92d468b817c tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:35.533800 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-6b7a1ffe-ef72-42aa-be97-b92d468b817c tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] [instance: 49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:35.540390 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6b7a1ffe-ef72-42aa-be97-b92d468b817c tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:35.540844 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6b7a1ffe-ef72-42aa-be97-b92d468b817c tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:35.541608 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6b7a1ffe-ef72-42aa-be97-b92d468b817c tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:35.542046 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6b7a1ffe-ef72-42aa-be97-b92d468b817c tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:35.609210 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-6b7a1ffe-ef72-42aa-be97-b92d468b817c tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbb45074cef4d5082580c4c5130eb9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b28cfcd2da41528eb3d71199d3b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:35.617928 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-6b7a1ffe-ef72-42aa-be97-b92d468b817c tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] 10.222.0.40 "GET /compute/v2.1/servers/49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3" status: 200 len: 1218 microversion: 2.1 time: 0.089219 Aug 03 05:14:35.621765 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 104/203] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:35 2022] GET /compute/v2.1/servers/49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:35.635703 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-6fc221e4-6392-4323-9c45-10412a158b56 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:35.636312 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-6fc221e4-6392-4323-9c45-10412a158b56 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 7ee7115a-8a61-415c-a4ba-b53c2aa0c442] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:35.653495 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-6fc221e4-6392-4323-9c45-10412a158b56 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:35.653495 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-6fc221e4-6392-4323-9c45-10412a158b56 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:35.653690 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-6fc221e4-6392-4323-9c45-10412a158b56 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:35.654174 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-6fc221e4-6392-4323-9c45-10412a158b56 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:35.812686 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-6fc221e4-6392-4323-9c45-10412a158b56 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:35.820531 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-6fc221e4-6392-4323-9c45-10412a158b56 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442" status: 200 len: 1521 microversion: 2.1 time: 0.189042 Aug 03 05:14:35.821103 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 100/204] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:35 2022] GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:36.646176 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-7b7ffcf5-4b1b-48ae-af6a-87e20ecb27d5 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:36.647339 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-7b7ffcf5-4b1b-48ae-af6a-87e20ecb27d5 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] [instance: 49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:36.654692 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7b7ffcf5-4b1b-48ae-af6a-87e20ecb27d5 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:36.655928 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7b7ffcf5-4b1b-48ae-af6a-87e20ecb27d5 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:36.656703 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7b7ffcf5-4b1b-48ae-af6a-87e20ecb27d5 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:36.657142 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7b7ffcf5-4b1b-48ae-af6a-87e20ecb27d5 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:36.763618 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-7b7ffcf5-4b1b-48ae-af6a-87e20ecb27d5 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbb45074cef4d5082580c4c5130eb9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b28cfcd2da41528eb3d71199d3b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:36.773096 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-7b7ffcf5-4b1b-48ae-af6a-87e20ecb27d5 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] 10.222.0.40 "GET /compute/v2.1/servers/49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3" status: 200 len: 1274 microversion: 2.1 time: 0.131212 Aug 03 05:14:36.773874 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 105/205] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:36 2022] GET /compute/v2.1/servers/49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3 => generated 1274 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:36.841590 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-423df9c0-d9c3-42d8-b93e-e5c7b822e46f tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:36.842381 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-423df9c0-d9c3-42d8-b93e-e5c7b822e46f tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 7ee7115a-8a61-415c-a4ba-b53c2aa0c442] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:36.849881 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-423df9c0-d9c3-42d8-b93e-e5c7b822e46f tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:36.850742 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-423df9c0-d9c3-42d8-b93e-e5c7b822e46f tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:36.851653 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-423df9c0-d9c3-42d8-b93e-e5c7b822e46f tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:36.852190 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-423df9c0-d9c3-42d8-b93e-e5c7b822e46f tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:37.173810 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-423df9c0-d9c3-42d8-b93e-e5c7b822e46f tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:37.183232 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-423df9c0-d9c3-42d8-b93e-e5c7b822e46f tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442" status: 200 len: 1521 microversion: 2.1 time: 0.344005 Aug 03 05:14:37.184910 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 101/206] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:36 2022] GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442 => generated 1521 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:37.795404 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-1f8787bc-1e84-4889-9064-31ed4b22072e tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:37.796649 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-1f8787bc-1e84-4889-9064-31ed4b22072e tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] [instance: 49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:37.803260 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1f8787bc-1e84-4889-9064-31ed4b22072e tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:37.803683 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1f8787bc-1e84-4889-9064-31ed4b22072e tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:37.804448 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1f8787bc-1e84-4889-9064-31ed4b22072e tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:37.804886 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1f8787bc-1e84-4889-9064-31ed4b22072e tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:38.005071 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-1f8787bc-1e84-4889-9064-31ed4b22072e tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbb45074cef4d5082580c4c5130eb9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b28cfcd2da41528eb3d71199d3b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:38.012809 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-1f8787bc-1e84-4889-9064-31ed4b22072e tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] 10.222.0.40 "GET /compute/v2.1/servers/49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3" status: 200 len: 1314 microversion: 2.1 time: 0.221582 Aug 03 05:14:38.013425 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 106/207] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:37 2022] GET /compute/v2.1/servers/49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:38.209574 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-b00feec3-24f8-4621-b546-087638fd5da0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:38.210508 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-b00feec3-24f8-4621-b546-087638fd5da0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 7ee7115a-8a61-415c-a4ba-b53c2aa0c442] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:38.219942 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b00feec3-24f8-4621-b546-087638fd5da0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:38.220833 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b00feec3-24f8-4621-b546-087638fd5da0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:38.221476 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b00feec3-24f8-4621-b546-087638fd5da0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:38.221917 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b00feec3-24f8-4621-b546-087638fd5da0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:38.296965 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-24612581-4f37-45a4-9a31-563fcc5ffb6e tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:38.297604 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-24612581-4f37-45a4-9a31-563fcc5ffb6e tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:38.303947 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-24612581-4f37-45a4-9a31-563fcc5ffb6e tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:38.304412 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-24612581-4f37-45a4-9a31-563fcc5ffb6e tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:38.305167 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-24612581-4f37-45a4-9a31-563fcc5ffb6e tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:38.305618 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-24612581-4f37-45a4-9a31-563fcc5ffb6e tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:38.334378 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-24612581-4f37-45a4-9a31-563fcc5ffb6e tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1/ips" status: 200 len: 151 microversion: 2.20 time: 0.041997 Aug 03 05:14:38.335007 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 107/208] 10.222.0.40 () {60 vars in 1289 bytes} [Wed Aug 3 05:14:38 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 05:14:38.386973 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-b00feec3-24f8-4621-b546-087638fd5da0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:38.399117 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-b00feec3-24f8-4621-b546-087638fd5da0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442" status: 200 len: 1521 microversion: 2.1 time: 0.192992 Aug 03 05:14:38.399117 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 102/209] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:38 2022] GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442 => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:39.034024 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-c013bebe-e139-4463-94d8-700342fb66aa tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:39.034649 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-c013bebe-e139-4463-94d8-700342fb66aa tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] [instance: 49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:39.041307 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c013bebe-e139-4463-94d8-700342fb66aa tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:39.041768 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c013bebe-e139-4463-94d8-700342fb66aa tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:39.042537 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c013bebe-e139-4463-94d8-700342fb66aa tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:39.043061 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c013bebe-e139-4463-94d8-700342fb66aa tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:39.188764 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-c013bebe-e139-4463-94d8-700342fb66aa tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbb45074cef4d5082580c4c5130eb9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b28cfcd2da41528eb3d71199d3b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:39.196772 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-c013bebe-e139-4463-94d8-700342fb66aa tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] 10.222.0.40 "GET /compute/v2.1/servers/49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3" status: 200 len: 1314 microversion: 2.1 time: 0.167183 Aug 03 05:14:39.198014 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 108/210] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:39 2022] GET /compute/v2.1/servers/49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:39.427674 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-f015161f-31c5-4a08-9431-1b2b56f9a4cd tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:39.428959 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-f015161f-31c5-4a08-9431-1b2b56f9a4cd tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 7ee7115a-8a61-415c-a4ba-b53c2aa0c442] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:39.437896 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f015161f-31c5-4a08-9431-1b2b56f9a4cd tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:39.438583 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f015161f-31c5-4a08-9431-1b2b56f9a4cd tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:39.439685 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f015161f-31c5-4a08-9431-1b2b56f9a4cd tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:39.440366 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f015161f-31c5-4a08-9431-1b2b56f9a4cd tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:39.655192 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-f015161f-31c5-4a08-9431-1b2b56f9a4cd tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:39.663120 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-f015161f-31c5-4a08-9431-1b2b56f9a4cd tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442" status: 200 len: 1521 microversion: 2.1 time: 0.242678 Aug 03 05:14:39.664012 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 103/211] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:39 2022] GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442 => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:14:40.041723 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-1868b2fe-4ba1-4ad6-a383-0c7e8c911969 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:40.042413 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-1868b2fe-4ba1-4ad6-a383-0c7e8c911969 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:40.054646 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1868b2fe-4ba1-4ad6-a383-0c7e8c911969 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:40.054646 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1868b2fe-4ba1-4ad6-a383-0c7e8c911969 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:40.056744 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1868b2fe-4ba1-4ad6-a383-0c7e8c911969 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:40.056744 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1868b2fe-4ba1-4ad6-a383-0c7e8c911969 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:40.085214 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-1868b2fe-4ba1-4ad6-a383-0c7e8c911969 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5/ips" status: 200 len: 146 microversion: 2.1 time: 0.047867 Aug 03 05:14:40.085921 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 109/212] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Aug 3 05:14:40 2022] GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5/ips => generated 146 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:14:40.149634 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [req-5fa34508-5077-4973-aeac-0fe1217296c0 req-2ca26eb5-674c-4b99-890c-86fbf4c248e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3", "tag": "f2ab039a-8219-434d-9b4b-67e3c8ffc9ba"}]} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:14:40.163978 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-5fa34508-5077-4973-aeac-0fe1217296c0 req-2ca26eb5-674c-4b99-890c-86fbf4c248e4 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:40.164791 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-5fa34508-5077-4973-aeac-0fe1217296c0 req-2ca26eb5-674c-4b99-890c-86fbf4c248e4 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:40.180861 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.compute.server_external_events [req-5fa34508-5077-4973-aeac-0fe1217296c0 req-2ca26eb5-674c-4b99-890c-86fbf4c248e4 service nova] Creating event network-changed:f2ab039a-8219-434d-9b4b-67e3c8ffc9ba for instance 49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3 on hv-cinder-85127 Aug 03 05:14:40.193200 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [req-5fa34508-5077-4973-aeac-0fe1217296c0 req-2ca26eb5-674c-4b99-890c-86fbf4c248e4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047502 Aug 03 05:14:40.194544 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 104/213] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:14:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:14:40.229029 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-213bcf73-0b04-43e9-a747-d521574dd8c5 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:40.231716 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-213bcf73-0b04-43e9-a747-d521574dd8c5 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] [instance: 49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:40.242274 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-213bcf73-0b04-43e9-a747-d521574dd8c5 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:40.247485 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-213bcf73-0b04-43e9-a747-d521574dd8c5 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:40.248708 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-213bcf73-0b04-43e9-a747-d521574dd8c5 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:40.249215 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-213bcf73-0b04-43e9-a747-d521574dd8c5 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:40.485032 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-213bcf73-0b04-43e9-a747-d521574dd8c5 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbb45074cef4d5082580c4c5130eb9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b28cfcd2da41528eb3d71199d3b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:40.492832 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-213bcf73-0b04-43e9-a747-d521574dd8c5 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] 10.222.0.40 "GET /compute/v2.1/servers/49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3" status: 200 len: 1314 microversion: 2.1 time: 0.277217 Aug 03 05:14:40.493413 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 110/214] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:40 2022] GET /compute/v2.1/servers/49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3 => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:40.685238 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-71d8d11f-eb78-41ce-a9a8-1bd0349e7f06 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:40.686584 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-71d8d11f-eb78-41ce-a9a8-1bd0349e7f06 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 7ee7115a-8a61-415c-a4ba-b53c2aa0c442] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:40.694795 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-71d8d11f-eb78-41ce-a9a8-1bd0349e7f06 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:40.695473 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-71d8d11f-eb78-41ce-a9a8-1bd0349e7f06 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:40.696408 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-71d8d11f-eb78-41ce-a9a8-1bd0349e7f06 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:40.697001 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-71d8d11f-eb78-41ce-a9a8-1bd0349e7f06 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:40.909375 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-71d8d11f-eb78-41ce-a9a8-1bd0349e7f06 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:40.930913 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:14:40.930913 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-71d8d11f-eb78-41ce-a9a8-1bd0349e7f06 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442" status: 200 len: 1521 microversion: 2.1 time: 0.238794 Aug 03 05:14:40.930913 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 105/215] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:40 2022] GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442 => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:41.515828 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-b1f1db0c-70e3-491a-8507-a429465fda9a tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:41.516524 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-b1f1db0c-70e3-491a-8507-a429465fda9a tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] [instance: 49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:41.524322 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b1f1db0c-70e3-491a-8507-a429465fda9a tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:41.524862 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b1f1db0c-70e3-491a-8507-a429465fda9a tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:41.525894 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b1f1db0c-70e3-491a-8507-a429465fda9a tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:41.526107 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b1f1db0c-70e3-491a-8507-a429465fda9a tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:41.720700 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-b1f1db0c-70e3-491a-8507-a429465fda9a tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbb45074cef4d5082580c4c5130eb9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b28cfcd2da41528eb3d71199d3b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:41.729633 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-b1f1db0c-70e3-491a-8507-a429465fda9a tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] 10.222.0.40 "GET /compute/v2.1/servers/49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3" status: 200 len: 1314 microversion: 2.1 time: 0.219257 Aug 03 05:14:41.744556 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 111/216] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:41 2022] GET /compute/v2.1/servers/49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:41.941422 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-87195489-6b43-4b45-a300-3d64741c7e99 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:41.946693 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-87195489-6b43-4b45-a300-3d64741c7e99 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 7ee7115a-8a61-415c-a4ba-b53c2aa0c442] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:41.952052 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-87195489-6b43-4b45-a300-3d64741c7e99 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:41.953103 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-87195489-6b43-4b45-a300-3d64741c7e99 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:41.953426 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-87195489-6b43-4b45-a300-3d64741c7e99 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:41.953950 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-87195489-6b43-4b45-a300-3d64741c7e99 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:41.974177 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-0d16aa80-6874-4d72-99e6-d04dee1fcafd tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:14:41.974711 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-0d16aa80-6874-4d72-99e6-d04dee1fcafd tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:41.981177 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0d16aa80-6874-4d72-99e6-d04dee1fcafd tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:41.981829 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0d16aa80-6874-4d72-99e6-d04dee1fcafd tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:41.982304 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0d16aa80-6874-4d72-99e6-d04dee1fcafd tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:41.982742 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0d16aa80-6874-4d72-99e6-d04dee1fcafd tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:42.000904 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=100 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:14:42.007694 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.objects.instance [None req-0d16aa80-6874-4d72-99e6-d04dee1fcafd tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lazy-loading 'flavor' on Instance uuid 69089938-1d69-415c-8344-e6b9f78f16d1 {{(pid=118331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:14:42.101965 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-87195489-6b43-4b45-a300-3d64741c7e99 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:42.109933 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-87195489-6b43-4b45-a300-3d64741c7e99 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442" status: 200 len: 1521 microversion: 2.1 time: 0.172380 Aug 03 05:14:42.110507 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 106/217] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:41 2022] GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:42.601310 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-0d16aa80-6874-4d72-99e6-d04dee1fcafd tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "POST /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1/action" status: 202 len: 0 microversion: 2.20 time: 0.631280 Aug 03 05:14:42.605389 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 112/218] 10.222.0.40 () {62 vars in 1319 bytes} [Wed Aug 3 05:14:41 2022] POST /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1/action => generated 0 bytes in 633 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 03 05:14:42.611640 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-75bc5d19-1581-4854-b426-8743a772c568 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:42.620755 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-75bc5d19-1581-4854-b426-8743a772c568 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:42.628951 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-75bc5d19-1581-4854-b426-8743a772c568 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:42.629430 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-75bc5d19-1581-4854-b426-8743a772c568 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:42.630170 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-75bc5d19-1581-4854-b426-8743a772c568 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:42.630565 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-75bc5d19-1581-4854-b426-8743a772c568 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:42.754661 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-bdaeee3f-25a7-477d-a517-b62c82fed22d tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:42.755484 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-bdaeee3f-25a7-477d-a517-b62c82fed22d tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] [instance: 49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:42.765992 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bdaeee3f-25a7-477d-a517-b62c82fed22d tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:42.766778 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bdaeee3f-25a7-477d-a517-b62c82fed22d tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:42.767859 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bdaeee3f-25a7-477d-a517-b62c82fed22d tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:42.768362 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bdaeee3f-25a7-477d-a517-b62c82fed22d tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:42.773360 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-75bc5d19-1581-4854-b426-8743a772c568 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:42.782046 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-75bc5d19-1581-4854-b426-8743a772c568 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:42.784470 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-75bc5d19-1581-4854-b426-8743a772c568 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:42.789103 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-75bc5d19-1581-4854-b426-8743a772c568 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1721 microversion: 2.20 time: 0.178225 Aug 03 05:14:42.789103 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 107/219] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:14:42 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:14:42.908293 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-bdaeee3f-25a7-477d-a517-b62c82fed22d tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbb45074cef4d5082580c4c5130eb9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b28cfcd2da41528eb3d71199d3b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:42.915861 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-bdaeee3f-25a7-477d-a517-b62c82fed22d tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] 10.222.0.40 "GET /compute/v2.1/servers/49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3" status: 200 len: 1314 microversion: 2.1 time: 0.167143 Aug 03 05:14:42.916757 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 113/220] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:42 2022] GET /compute/v2.1/servers/49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:14:43.131275 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-0853ba2d-ef27-4318-8f62-0c74ed95b39b tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:43.131881 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-0853ba2d-ef27-4318-8f62-0c74ed95b39b tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 7ee7115a-8a61-415c-a4ba-b53c2aa0c442] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:43.138105 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-0853ba2d-ef27-4318-8f62-0c74ed95b39b tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:43.138554 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-0853ba2d-ef27-4318-8f62-0c74ed95b39b tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:43.139547 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-0853ba2d-ef27-4318-8f62-0c74ed95b39b tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:43.139769 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-0853ba2d-ef27-4318-8f62-0c74ed95b39b tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:43.275569 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-0853ba2d-ef27-4318-8f62-0c74ed95b39b tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:43.291618 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-0853ba2d-ef27-4318-8f62-0c74ed95b39b tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442" status: 200 len: 1521 microversion: 2.1 time: 0.161958 Aug 03 05:14:43.291618 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 108/221] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:43 2022] GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:43.364338 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-45de85a3-8d44-4819-ac40-90bed6908099 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a8b2125-a580-47c5-83a4-6ae61e6a6a4e"}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:14:43.366750 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-45de85a3-8d44-4819-ac40-90bed6908099 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:43.372783 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-45de85a3-8d44-4819-ac40-90bed6908099 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:43.373316 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-45de85a3-8d44-4819-ac40-90bed6908099 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:43.374671 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-45de85a3-8d44-4819-ac40-90bed6908099 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:43.375301 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-45de85a3-8d44-4819-ac40-90bed6908099 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:43.809874 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-34672255-9224-460b-877c-9bd7c35c5a11 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:43.810574 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-34672255-9224-460b-877c-9bd7c35c5a11 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:43.816578 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-34672255-9224-460b-877c-9bd7c35c5a11 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:43.817028 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-34672255-9224-460b-877c-9bd7c35c5a11 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:43.817791 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-34672255-9224-460b-877c-9bd7c35c5a11 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:43.818227 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-34672255-9224-460b-877c-9bd7c35c5a11 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:43.958185 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-34672255-9224-460b-877c-9bd7c35c5a11 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:43.966272 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-34672255-9224-460b-877c-9bd7c35c5a11 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:43.968459 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-34672255-9224-460b-877c-9bd7c35c5a11 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:43.970749 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-34672255-9224-460b-877c-9bd7c35c5a11 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1721 microversion: 2.20 time: 0.164883 Aug 03 05:14:43.971542 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 109/222] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:14:43 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 05:14:43.976136 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-a3558ff2-6abb-4912-aa3f-545079740906 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:43.976753 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-a3558ff2-6abb-4912-aa3f-545079740906 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] [instance: 49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:43.982775 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-a3558ff2-6abb-4912-aa3f-545079740906 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:43.983846 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-a3558ff2-6abb-4912-aa3f-545079740906 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:43.984627 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-a3558ff2-6abb-4912-aa3f-545079740906 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:43.985073 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-a3558ff2-6abb-4912-aa3f-545079740906 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:44.118471 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-a3558ff2-6abb-4912-aa3f-545079740906 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbb45074cef4d5082580c4c5130eb9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b28cfcd2da41528eb3d71199d3b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:44.125999 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-a3558ff2-6abb-4912-aa3f-545079740906 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] 10.222.0.40 "GET /compute/v2.1/servers/49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3" status: 200 len: 1314 microversion: 2.1 time: 0.153536 Aug 03 05:14:44.126585 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 110/223] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:43 2022] GET /compute/v2.1/servers/49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:44.191788 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell0:SELECT=2 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:14:44.312544 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-53c69977-ac52-4f57-a008-75669a027af7 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:44.313202 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-53c69977-ac52-4f57-a008-75669a027af7 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 7ee7115a-8a61-415c-a4ba-b53c2aa0c442] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:44.319441 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-53c69977-ac52-4f57-a008-75669a027af7 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:44.319892 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-53c69977-ac52-4f57-a008-75669a027af7 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:44.320801 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-53c69977-ac52-4f57-a008-75669a027af7 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:44.321258 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-53c69977-ac52-4f57-a008-75669a027af7 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:44.456598 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-53c69977-ac52-4f57-a008-75669a027af7 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:44.463775 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-53c69977-ac52-4f57-a008-75669a027af7 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442" status: 200 len: 1521 microversion: 2.1 time: 0.155067 Aug 03 05:14:44.464488 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 111/224] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:44 2022] GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:14:44.504884 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell0:SELECT=8 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:14:44.590172 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-45de85a3-8d44-4819-ac40-90bed6908099 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "POST /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.229921 Aug 03 05:14:44.591131 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 114/225] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Aug 3 05:14:43 2022] POST /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5/os-volume_attachments => generated 194 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:14:44.995315 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-b41ba8ff-08c2-4162-8bd6-7c515a3c0bc4 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:44.995986 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-b41ba8ff-08c2-4162-8bd6-7c515a3c0bc4 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:45.002067 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b41ba8ff-08c2-4162-8bd6-7c515a3c0bc4 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:45.002519 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b41ba8ff-08c2-4162-8bd6-7c515a3c0bc4 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:45.003484 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b41ba8ff-08c2-4162-8bd6-7c515a3c0bc4 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:45.003765 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b41ba8ff-08c2-4162-8bd6-7c515a3c0bc4 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:45.150354 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-c5c8b149-60b8-45b9-907e-2682eed0f0ce tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:45.151117 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-c5c8b149-60b8-45b9-907e-2682eed0f0ce tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] [instance: 49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:45.155696 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-b41ba8ff-08c2-4162-8bd6-7c515a3c0bc4 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:45.162034 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c5c8b149-60b8-45b9-907e-2682eed0f0ce tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:45.162479 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c5c8b149-60b8-45b9-907e-2682eed0f0ce tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:45.163309 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c5c8b149-60b8-45b9-907e-2682eed0f0ce tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:45.165289 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c5c8b149-60b8-45b9-907e-2682eed0f0ce tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:45.166865 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-b41ba8ff-08c2-4162-8bd6-7c515a3c0bc4 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:45.168586 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-b41ba8ff-08c2-4162-8bd6-7c515a3c0bc4 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:45.169975 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-b41ba8ff-08c2-4162-8bd6-7c515a3c0bc4 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1721 microversion: 2.20 time: 0.178587 Aug 03 05:14:45.170823 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 112/226] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:14:44 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:14:45.334944 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-c5c8b149-60b8-45b9-907e-2682eed0f0ce tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbb45074cef4d5082580c4c5130eb9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b28cfcd2da41528eb3d71199d3b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:45.345355 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-c5c8b149-60b8-45b9-907e-2682eed0f0ce tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] 10.222.0.40 "GET /compute/v2.1/servers/49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3" status: 200 len: 1314 microversion: 2.1 time: 0.200203 Aug 03 05:14:45.355575 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 115/227] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:45 2022] GET /compute/v2.1/servers/49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:45.487765 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-51f50b73-5b8a-4806-8149-83166090acba tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:45.488303 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-51f50b73-5b8a-4806-8149-83166090acba tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 7ee7115a-8a61-415c-a4ba-b53c2aa0c442] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:45.494131 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-51f50b73-5b8a-4806-8149-83166090acba tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:45.494573 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-51f50b73-5b8a-4806-8149-83166090acba tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:45.495357 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-51f50b73-5b8a-4806-8149-83166090acba tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:45.495792 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-51f50b73-5b8a-4806-8149-83166090acba tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:45.704635 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-51f50b73-5b8a-4806-8149-83166090acba tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:45.704635 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-51f50b73-5b8a-4806-8149-83166090acba tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442" status: 200 len: 1521 microversion: 2.1 time: 0.160320 Aug 03 05:14:45.704635 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 113/228] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:45 2022] GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:46.198131 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-f5c4ab78-d9fd-4144-9dfb-560b64bf12d1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:46.206828 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-f5c4ab78-d9fd-4144-9dfb-560b64bf12d1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:46.206828 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f5c4ab78-d9fd-4144-9dfb-560b64bf12d1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:46.206828 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f5c4ab78-d9fd-4144-9dfb-560b64bf12d1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:46.207524 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f5c4ab78-d9fd-4144-9dfb-560b64bf12d1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:46.207977 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f5c4ab78-d9fd-4144-9dfb-560b64bf12d1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:46.351125 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-f5c4ab78-d9fd-4144-9dfb-560b64bf12d1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:46.359531 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-f5c4ab78-d9fd-4144-9dfb-560b64bf12d1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:46.361054 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-f5c4ab78-d9fd-4144-9dfb-560b64bf12d1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:46.362229 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-f5c4ab78-d9fd-4144-9dfb-560b64bf12d1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1721 microversion: 2.20 time: 0.168444 Aug 03 05:14:46.363093 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 116/229] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:14:46 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 05:14:46.368026 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-85005051-c5f8-476f-a314-8ee932cc37ab tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:46.368634 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-85005051-c5f8-476f-a314-8ee932cc37ab tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] [instance: 49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:46.375478 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-85005051-c5f8-476f-a314-8ee932cc37ab tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:46.375935 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-85005051-c5f8-476f-a314-8ee932cc37ab tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:46.376732 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-85005051-c5f8-476f-a314-8ee932cc37ab tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:46.377337 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-85005051-c5f8-476f-a314-8ee932cc37ab tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:46.565633 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-85005051-c5f8-476f-a314-8ee932cc37ab tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbb45074cef4d5082580c4c5130eb9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b28cfcd2da41528eb3d71199d3b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:46.573116 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-85005051-c5f8-476f-a314-8ee932cc37ab tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] 10.222.0.40 "GET /compute/v2.1/servers/49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3" status: 200 len: 1314 microversion: 2.1 time: 0.208972 Aug 03 05:14:46.574965 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 114/230] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:46 2022] GET /compute/v2.1/servers/49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:46.720438 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-875eba2a-7c4a-43ce-a6fc-b53b348852b7 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:46.721071 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-875eba2a-7c4a-43ce-a6fc-b53b348852b7 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 7ee7115a-8a61-415c-a4ba-b53c2aa0c442] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:46.727102 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-875eba2a-7c4a-43ce-a6fc-b53b348852b7 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:46.727561 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-875eba2a-7c4a-43ce-a6fc-b53b348852b7 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:46.728331 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-875eba2a-7c4a-43ce-a6fc-b53b348852b7 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:46.728775 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-875eba2a-7c4a-43ce-a6fc-b53b348852b7 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:46.857640 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-875eba2a-7c4a-43ce-a6fc-b53b348852b7 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:46.865283 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-875eba2a-7c4a-43ce-a6fc-b53b348852b7 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442" status: 200 len: 1521 microversion: 2.1 time: 0.150409 Aug 03 05:14:46.868095 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 117/231] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:46 2022] GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:47.388843 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-3a2d8e03-d32d-4670-ac04-475972dff066 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:47.389486 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-3a2d8e03-d32d-4670-ac04-475972dff066 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:47.396186 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3a2d8e03-d32d-4670-ac04-475972dff066 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:47.396647 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3a2d8e03-d32d-4670-ac04-475972dff066 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:47.397407 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3a2d8e03-d32d-4670-ac04-475972dff066 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:47.397844 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3a2d8e03-d32d-4670-ac04-475972dff066 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:47.555726 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-3a2d8e03-d32d-4670-ac04-475972dff066 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:47.579662 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-3a2d8e03-d32d-4670-ac04-475972dff066 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:47.579662 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-3a2d8e03-d32d-4670-ac04-475972dff066 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:47.579662 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-3a2d8e03-d32d-4670-ac04-475972dff066 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1721 microversion: 2.20 time: 0.184244 Aug 03 05:14:47.580525 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 115/232] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:14:47 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1721 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:14:47.596082 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-7b6a803f-6f08-4e1f-b815-21016b043803 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:47.596622 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-7b6a803f-6f08-4e1f-b815-21016b043803 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] [instance: 49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:47.602763 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7b6a803f-6f08-4e1f-b815-21016b043803 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:47.603254 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7b6a803f-6f08-4e1f-b815-21016b043803 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:47.604008 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7b6a803f-6f08-4e1f-b815-21016b043803 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:47.604451 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7b6a803f-6f08-4e1f-b815-21016b043803 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:47.748664 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-7b6a803f-6f08-4e1f-b815-21016b043803 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbb45074cef4d5082580c4c5130eb9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b28cfcd2da41528eb3d71199d3b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:47.756977 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-7b6a803f-6f08-4e1f-b815-21016b043803 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] 10.222.0.40 "GET /compute/v2.1/servers/49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3" status: 200 len: 1314 microversion: 2.1 time: 0.165748 Aug 03 05:14:47.757563 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 118/233] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:47 2022] GET /compute/v2.1/servers/49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:47.890639 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-953fc05f-5aea-4fd8-be3a-95db63e043f9 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:47.891379 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-953fc05f-5aea-4fd8-be3a-95db63e043f9 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 7ee7115a-8a61-415c-a4ba-b53c2aa0c442] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:47.897954 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-953fc05f-5aea-4fd8-be3a-95db63e043f9 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:47.898470 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-953fc05f-5aea-4fd8-be3a-95db63e043f9 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:47.899408 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-953fc05f-5aea-4fd8-be3a-95db63e043f9 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:47.900065 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-953fc05f-5aea-4fd8-be3a-95db63e043f9 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:48.086453 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-953fc05f-5aea-4fd8-be3a-95db63e043f9 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:48.098461 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-953fc05f-5aea-4fd8-be3a-95db63e043f9 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442" status: 200 len: 1521 microversion: 2.1 time: 0.215541 Aug 03 05:14:48.099099 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 116/234] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:47 2022] GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442 => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:48.596954 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-a5cef81d-e047-4a49-b0be-1a831ccf524b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:48.597585 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-a5cef81d-e047-4a49-b0be-1a831ccf524b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:48.603944 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a5cef81d-e047-4a49-b0be-1a831ccf524b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:48.604641 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a5cef81d-e047-4a49-b0be-1a831ccf524b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:48.605408 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a5cef81d-e047-4a49-b0be-1a831ccf524b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:48.605842 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a5cef81d-e047-4a49-b0be-1a831ccf524b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:48.705957 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [req-55096857-59f8-4829-8280-edb663e2ed9b req-5715ad6a-dd23-4394-9600-090f0077b73d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3", "name": "network-vif-plugged", "status": "completed", "tag": "f2ab039a-8219-434d-9b4b-67e3c8ffc9ba"}]} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:14:48.717671 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-55096857-59f8-4829-8280-edb663e2ed9b req-5715ad6a-dd23-4394-9600-090f0077b73d service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:48.718754 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-55096857-59f8-4829-8280-edb663e2ed9b req-5715ad6a-dd23-4394-9600-090f0077b73d service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:48.731489 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.compute.server_external_events [req-55096857-59f8-4829-8280-edb663e2ed9b req-5715ad6a-dd23-4394-9600-090f0077b73d service nova] Creating event network-vif-plugged:f2ab039a-8219-434d-9b4b-67e3c8ffc9ba for instance 49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3 on hv-cinder-85127 Aug 03 05:14:48.737438 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [req-55096857-59f8-4829-8280-edb663e2ed9b req-5715ad6a-dd23-4394-9600-090f0077b73d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038343 Aug 03 05:14:48.741524 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 117/235] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:14:48.785966 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-e0bad6fa-64e4-49cb-99e5-ef489efe1681 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:48.786805 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-e0bad6fa-64e4-49cb-99e5-ef489efe1681 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] [instance: 49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:48.795706 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e0bad6fa-64e4-49cb-99e5-ef489efe1681 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:48.799084 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e0bad6fa-64e4-49cb-99e5-ef489efe1681 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:48.799084 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e0bad6fa-64e4-49cb-99e5-ef489efe1681 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:48.799084 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e0bad6fa-64e4-49cb-99e5-ef489efe1681 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:48.824146 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-a5cef81d-e047-4a49-b0be-1a831ccf524b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:48.835654 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-a5cef81d-e047-4a49-b0be-1a831ccf524b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:48.837220 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-a5cef81d-e047-4a49-b0be-1a831ccf524b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:48.847827 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-a5cef81d-e047-4a49-b0be-1a831ccf524b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1721 microversion: 2.20 time: 0.255876 Aug 03 05:14:48.848555 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 119/236] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:14:48 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1721 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:14:49.026708 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-e0bad6fa-64e4-49cb-99e5-ef489efe1681 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbb45074cef4d5082580c4c5130eb9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b28cfcd2da41528eb3d71199d3b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:49.034827 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-e0bad6fa-64e4-49cb-99e5-ef489efe1681 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] 10.222.0.40 "GET /compute/v2.1/servers/49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3" status: 200 len: 1314 microversion: 2.1 time: 0.254361 Aug 03 05:14:49.035640 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 118/237] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:48 2022] GET /compute/v2.1/servers/49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3 => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:49.128427 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-0135514b-82c6-4db4-b852-5ae8724ae8df tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:49.129257 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-0135514b-82c6-4db4-b852-5ae8724ae8df tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 7ee7115a-8a61-415c-a4ba-b53c2aa0c442] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:49.135279 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0135514b-82c6-4db4-b852-5ae8724ae8df tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:49.135808 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0135514b-82c6-4db4-b852-5ae8724ae8df tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:49.136584 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0135514b-82c6-4db4-b852-5ae8724ae8df tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:49.137035 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0135514b-82c6-4db4-b852-5ae8724ae8df tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:49.275987 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-0135514b-82c6-4db4-b852-5ae8724ae8df tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:49.284397 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-0135514b-82c6-4db4-b852-5ae8724ae8df tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442" status: 200 len: 1521 microversion: 2.1 time: 0.160419 Aug 03 05:14:49.284990 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 120/238] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:49 2022] GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:49.880037 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-8b043f24-be87-4276-930c-72affad28bb5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:49.881404 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-8b043f24-be87-4276-930c-72affad28bb5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:49.888094 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-8b043f24-be87-4276-930c-72affad28bb5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:49.888675 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-8b043f24-be87-4276-930c-72affad28bb5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:49.889512 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-8b043f24-be87-4276-930c-72affad28bb5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:49.890131 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-8b043f24-be87-4276-930c-72affad28bb5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:50.057457 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-38a5746b-c550-47b9-bd8d-1864579ef211 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:50.058656 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-38a5746b-c550-47b9-bd8d-1864579ef211 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] [instance: 49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:50.065251 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-38a5746b-c550-47b9-bd8d-1864579ef211 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:50.065946 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-38a5746b-c550-47b9-bd8d-1864579ef211 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:50.066723 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-38a5746b-c550-47b9-bd8d-1864579ef211 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:50.067349 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-38a5746b-c550-47b9-bd8d-1864579ef211 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:50.082293 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-8b043f24-be87-4276-930c-72affad28bb5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:50.100695 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-8b043f24-be87-4276-930c-72affad28bb5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:50.103843 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-8b043f24-be87-4276-930c-72affad28bb5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:50.106646 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-8b043f24-be87-4276-930c-72affad28bb5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1721 microversion: 2.20 time: 0.230904 Aug 03 05:14:50.108300 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 119/239] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:14:49 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1721 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:14:50.306120 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-2885ff34-a256-4023-b19f-6109fd8550b6 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:50.306893 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-2885ff34-a256-4023-b19f-6109fd8550b6 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 7ee7115a-8a61-415c-a4ba-b53c2aa0c442] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:50.313935 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-2885ff34-a256-4023-b19f-6109fd8550b6 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:50.314577 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-2885ff34-a256-4023-b19f-6109fd8550b6 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:50.316130 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-2885ff34-a256-4023-b19f-6109fd8550b6 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:50.316572 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-2885ff34-a256-4023-b19f-6109fd8550b6 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:50.517314 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-38a5746b-c550-47b9-bd8d-1864579ef211 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbb45074cef4d5082580c4c5130eb9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b28cfcd2da41528eb3d71199d3b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:50.528537 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-38a5746b-c550-47b9-bd8d-1864579ef211 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] 10.222.0.40 "GET /compute/v2.1/servers/49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3" status: 200 len: 1314 microversion: 2.1 time: 0.474966 Aug 03 05:14:50.529370 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 121/240] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:50 2022] GET /compute/v2.1/servers/49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3 => generated 1314 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:50.611054 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-2885ff34-a256-4023-b19f-6109fd8550b6 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:50.622130 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-2885ff34-a256-4023-b19f-6109fd8550b6 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442" status: 200 len: 1521 microversion: 2.1 time: 0.319883 Aug 03 05:14:50.626226 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 120/241] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:50 2022] GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442 => generated 1521 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:51.132382 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-b10ed36b-d648-44f7-b568-857550552e74 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:51.133792 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-b10ed36b-d648-44f7-b568-857550552e74 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:51.142322 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b10ed36b-d648-44f7-b568-857550552e74 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:51.142777 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b10ed36b-d648-44f7-b568-857550552e74 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:51.147110 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b10ed36b-d648-44f7-b568-857550552e74 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:51.147644 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b10ed36b-d648-44f7-b568-857550552e74 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:51.384209 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-b10ed36b-d648-44f7-b568-857550552e74 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:51.394053 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-b10ed36b-d648-44f7-b568-857550552e74 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:51.398068 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-b10ed36b-d648-44f7-b568-857550552e74 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:51.406133 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-b10ed36b-d648-44f7-b568-857550552e74 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1721 microversion: 2.20 time: 0.272183 Aug 03 05:14:51.407958 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 122/242] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:14:51 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1721 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:14:51.549813 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-2c35195d-53f4-4b15-91ff-5b150d83ba19 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:51.550554 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-2c35195d-53f4-4b15-91ff-5b150d83ba19 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] [instance: 49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:51.557026 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-2c35195d-53f4-4b15-91ff-5b150d83ba19 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:51.557482 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-2c35195d-53f4-4b15-91ff-5b150d83ba19 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:51.558267 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-2c35195d-53f4-4b15-91ff-5b150d83ba19 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:51.558710 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-2c35195d-53f4-4b15-91ff-5b150d83ba19 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:51.644621 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-b7ff60c8-fc8d-4d14-9222-7c769f659c55 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:51.645629 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-b7ff60c8-fc8d-4d14-9222-7c769f659c55 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 7ee7115a-8a61-415c-a4ba-b53c2aa0c442] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:51.652507 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b7ff60c8-fc8d-4d14-9222-7c769f659c55 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:51.653064 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b7ff60c8-fc8d-4d14-9222-7c769f659c55 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:51.653978 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b7ff60c8-fc8d-4d14-9222-7c769f659c55 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:51.654486 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b7ff60c8-fc8d-4d14-9222-7c769f659c55 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:51.973012 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-2c35195d-53f4-4b15-91ff-5b150d83ba19 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbb45074cef4d5082580c4c5130eb9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b28cfcd2da41528eb3d71199d3b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:51.986380 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-2c35195d-53f4-4b15-91ff-5b150d83ba19 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] 10.222.0.40 "GET /compute/v2.1/servers/49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3" status: 200 len: 1314 microversion: 2.1 time: 0.440453 Aug 03 05:14:51.986591 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-b7ff60c8-fc8d-4d14-9222-7c769f659c55 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:51.987008 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 121/243] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:51 2022] GET /compute/v2.1/servers/49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3 => generated 1314 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:14:51.996302 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-b7ff60c8-fc8d-4d14-9222-7c769f659c55 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442" status: 200 len: 1521 microversion: 2.1 time: 0.356104 Aug 03 05:14:51.997587 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 123/244] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:51 2022] GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442 => generated 1521 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:14:52.438449 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-3f4a8242-3452-4726-a56d-4df0db2c2279 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:52.453029 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-3f4a8242-3452-4726-a56d-4df0db2c2279 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:52.505991 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3f4a8242-3452-4726-a56d-4df0db2c2279 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:52.509254 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3f4a8242-3452-4726-a56d-4df0db2c2279 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:52.511880 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3f4a8242-3452-4726-a56d-4df0db2c2279 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:52.512627 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3f4a8242-3452-4726-a56d-4df0db2c2279 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:52.683551 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-3f4a8242-3452-4726-a56d-4df0db2c2279 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:52.695254 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-3f4a8242-3452-4726-a56d-4df0db2c2279 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:52.697185 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-3f4a8242-3452-4726-a56d-4df0db2c2279 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:52.698468 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-3f4a8242-3452-4726-a56d-4df0db2c2279 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1721 microversion: 2.20 time: 0.269285 Aug 03 05:14:52.699245 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 122/245] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:14:52 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1721 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:14:53.009410 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-ad060510-3ca4-45ec-bdca-6f9862e016f7 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:53.010098 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-ad060510-3ca4-45ec-bdca-6f9862e016f7 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] [instance: 49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:53.017825 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ad060510-3ca4-45ec-bdca-6f9862e016f7 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:53.018278 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ad060510-3ca4-45ec-bdca-6f9862e016f7 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:53.018589 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-1652e5ef-4e03-4bec-a509-042950819432 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:53.019078 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ad060510-3ca4-45ec-bdca-6f9862e016f7 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:53.019215 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-1652e5ef-4e03-4bec-a509-042950819432 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 7ee7115a-8a61-415c-a4ba-b53c2aa0c442] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:53.019812 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ad060510-3ca4-45ec-bdca-6f9862e016f7 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:53.028108 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-1652e5ef-4e03-4bec-a509-042950819432 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:53.028580 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-1652e5ef-4e03-4bec-a509-042950819432 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:53.029372 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-1652e5ef-4e03-4bec-a509-042950819432 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:53.029820 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-1652e5ef-4e03-4bec-a509-042950819432 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:53.038908 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_cell1:SELECT=100 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:14:53.268523 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-1652e5ef-4e03-4bec-a509-042950819432 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:53.276382 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-1652e5ef-4e03-4bec-a509-042950819432 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442" status: 200 len: 1521 microversion: 2.1 time: 0.261607 Aug 03 05:14:53.276553 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-ad060510-3ca4-45ec-bdca-6f9862e016f7 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbb45074cef4d5082580c4c5130eb9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b28cfcd2da41528eb3d71199d3b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:53.277528 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 123/246] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:53 2022] GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:53.285893 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-ad060510-3ca4-45ec-bdca-6f9862e016f7 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] 10.222.0.40 "GET /compute/v2.1/servers/49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3" status: 200 len: 1314 microversion: 2.1 time: 0.280922 Aug 03 05:14:53.286460 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 124/247] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:53 2022] GET /compute/v2.1/servers/49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3 => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:53.723471 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-a88f3ac3-701c-4e3d-b621-09ac59861bbe tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:53.724528 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-a88f3ac3-701c-4e3d-b621-09ac59861bbe tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:53.734717 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-a88f3ac3-701c-4e3d-b621-09ac59861bbe tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:53.734717 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-a88f3ac3-701c-4e3d-b621-09ac59861bbe tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:53.734717 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-a88f3ac3-701c-4e3d-b621-09ac59861bbe tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:53.734717 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-a88f3ac3-701c-4e3d-b621-09ac59861bbe tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:53.942055 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-a88f3ac3-701c-4e3d-b621-09ac59861bbe tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:53.950726 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-a88f3ac3-701c-4e3d-b621-09ac59861bbe tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:53.956870 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-a88f3ac3-701c-4e3d-b621-09ac59861bbe tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:53.960680 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-a88f3ac3-701c-4e3d-b621-09ac59861bbe tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1721 microversion: 2.20 time: 0.242522 Aug 03 05:14:53.963479 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 124/248] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:14:53 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1721 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:14:54.301495 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-38472029-3059-4461-9860-2fe295c025e9 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:54.308981 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-d23432c7-abfc-4b9d-a1ae-3e591861c099 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:54.312539 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-38472029-3059-4461-9860-2fe295c025e9 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 7ee7115a-8a61-415c-a4ba-b53c2aa0c442] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:54.314446 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-d23432c7-abfc-4b9d-a1ae-3e591861c099 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] [instance: 49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:54.320272 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-38472029-3059-4461-9860-2fe295c025e9 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:54.320908 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-38472029-3059-4461-9860-2fe295c025e9 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:54.321893 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-38472029-3059-4461-9860-2fe295c025e9 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:54.322505 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-38472029-3059-4461-9860-2fe295c025e9 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:54.327329 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-d23432c7-abfc-4b9d-a1ae-3e591861c099 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:54.327851 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-d23432c7-abfc-4b9d-a1ae-3e591861c099 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:54.328677 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-d23432c7-abfc-4b9d-a1ae-3e591861c099 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:54.329119 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-d23432c7-abfc-4b9d-a1ae-3e591861c099 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:54.663039 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-38472029-3059-4461-9860-2fe295c025e9 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:54.673238 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:14:54.678865 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-d23432c7-abfc-4b9d-a1ae-3e591861c099 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbb45074cef4d5082580c4c5130eb9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b28cfcd2da41528eb3d71199d3b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:54.679577 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-38472029-3059-4461-9860-2fe295c025e9 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442" status: 200 len: 1501 microversion: 2.1 time: 0.382245 Aug 03 05:14:54.680983 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 125/249] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:54 2022] GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442 => generated 1501 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:54.688697 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-d23432c7-abfc-4b9d-a1ae-3e591861c099 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] 10.222.0.40 "GET /compute/v2.1/servers/49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3" status: 200 len: 1314 microversion: 2.1 time: 0.384300 Aug 03 05:14:54.689488 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 125/250] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:54 2022] GET /compute/v2.1/servers/49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3 => generated 1314 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:14:54.718591 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-9fd3cce4-1548-4216-b6c9-90fc6c66c930 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "04ac617f-c740-4dcf-9c83-5d0a2c462d67"}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:14:54.718591 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-9fd3cce4-1548-4216-b6c9-90fc6c66c930 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 7ee7115a-8a61-415c-a4ba-b53c2aa0c442] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:54.721222 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9fd3cce4-1548-4216-b6c9-90fc6c66c930 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:54.722808 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9fd3cce4-1548-4216-b6c9-90fc6c66c930 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:54.724036 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9fd3cce4-1548-4216-b6c9-90fc6c66c930 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:54.724486 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9fd3cce4-1548-4216-b6c9-90fc6c66c930 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:54.755646 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.wsgi [None req-9fd3cce4-1548-4216-b6c9-90fc6c66c930 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] HTTP exception thrown: Cannot 'attach_volume' instance 7ee7115a-8a61-415c-a4ba-b53c2aa0c442 while it is in vm_state rescued Aug 03 05:14:54.758160 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-9fd3cce4-1548-4216-b6c9-90fc6c66c930 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Request method failure captured: Aug 03 05:14:54.758160 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: request: POST /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442/os-volume_attachments HTTP/1.1 Aug 03 05:14:54.758160 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Accept: application/json Aug 03 05:14:54.758160 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Accept-Encoding: identity Aug 03 05:14:54.758160 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Connection: close Aug 03 05:14:54.758160 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Content-Length: 74 Aug 03 05:14:54.758160 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Content-Type: application/json Aug 03 05:14:54.758160 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Host: 10.222.0.40 Aug 03 05:14:54.758160 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Openstack-System-Scope: None Aug 03 05:14:54.758160 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: User-Agent: python-urllib3/1.26.10 Aug 03 05:14:54.758160 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Auth-Token: gAAAAABi6gPTVv1oE_O2DS7JexgjiVZZ5yTvwFfTDvv3fgwnZVMm1QuvOqQPlPZjdlHsUhwyK7cAnIGz147fLocUeEXFYRmV5CkqTfDI-9PO3MxodM9kCsKki6-i9zKuoaKrTaTYSrvfPqxK8YsU3BCLBF7PgTgJHbL8c6JahRaay9047vP40N4 Aug 03 05:14:54.758160 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Domain-Id: None Aug 03 05:14:54.758160 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Domain-Name: None Aug 03 05:14:54.758160 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Identity-Status: Confirmed Aug 03 05:14:54.758160 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Is-Admin-Project: True Aug 03 05:14:54.758160 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Domain-Id: default Aug 03 05:14:54.758160 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Domain-Name: Default Aug 03 05:14:54.758160 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Id: 829c8e80e96d40d682a17185eb4da336 Aug 03 05:14:54.758160 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1128427595 Aug 03 05:14:54.758160 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Role: member,reader Aug 03 05:14:54.758160 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Roles: member,reader Aug 03 05:14:54.759662 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_829c8e80e96d40d682a17185eb4da336"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/829c8e80e96d40d682a17185eb4da336"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/829c8e80e96d40d682a17185eb4da336"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/829c8e80e96d40d682a17185eb4da336"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:14:54.759662 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1128427595 Aug 03 05:14:54.759662 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant-Id: 829c8e80e96d40d682a17185eb4da336 Aug 03 05:14:54.759662 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1128427595 Aug 03 05:14:54.759662 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User: tempest-ServerRescueNegativeTestJSON-1128427595-project Aug 03 05:14:54.759662 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Domain-Id: default Aug 03 05:14:54.759662 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Domain-Name: Default Aug 03 05:14:54.759662 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Id: bb0fe4cb98e0447cad3e126da1a8de9c Aug 03 05:14:54.759662 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1128427595-project Aug 03 05:14:54.759662 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Aug 03 05:14:54.759662 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: {"volumeAttachment": {"volumeId": "04ac617f-c740-4dcf-9c83-5d0a2c462d67"}} Aug 03 05:14:54.759662 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: method: > Aug 03 05:14:54.760516 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: exception: Cannot 'attach_volume' instance 7ee7115a-8a61-415c-a4ba-b53c2aa0c442 while it is in vm_state rescued Aug 03 05:14:54.760516 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: action_args: {'server_id': '7ee7115a-8a61-415c-a4ba-b53c2aa0c442', 'body': {'volumeAttachment': {'volumeId': '04ac617f-c740-4dcf-9c83-5d0a2c462d67'}}} Aug 03 05:14:54.760516 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:14:54.760516 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:14:54.760516 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 03 05:14:54.760516 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 03 05:14:54.760516 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 05:14:54.760516 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 05:14:54.760516 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 03 05:14:54.760516 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 03 05:14:54.760516 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7ee7115a-8a61-415c-a4ba-b53c2aa0c442 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 03 05:14:54.760516 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:14:54.760516 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:14:54.760516 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:14:54.760516 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:14:54.760516 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:14:54.760516 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:14:54.760516 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:14:54.760516 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:14:54.761894 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:14:54.761894 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:14:54.761894 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 05:14:54.761894 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 05:14:54.761894 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 05:14:54.761894 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 05:14:54.761894 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 05:14:54.761894 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 05:14:54.761894 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 03 05:14:54.761894 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 03 05:14:54.761894 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 03 05:14:54.761894 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 03 05:14:54.761894 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 7ee7115a-8a61-415c-a4ba-b53c2aa0c442 while it is in vm_state rescued Aug 03 05:14:54.761894 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:14:54.761894 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:14:54.761894 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:14:54.761894 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:14:54.761894 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:14:54.761894 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:14:54.763286 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:14:54.763286 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:14:54.763286 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 7ee7115a-8a61-415c-a4ba-b53c2aa0c442 while it is in vm_state rescued Aug 03 05:14:54.763286 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:14:54.766259 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-9fd3cce4-1548-4216-b6c9-90fc6c66c930 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Returning 409 to user: Cannot 'attach_volume' instance 7ee7115a-8a61-415c-a4ba-b53c2aa0c442 while it is in vm_state rescued {{(pid=118331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:14:54.771434 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-9fd3cce4-1548-4216-b6c9-90fc6c66c930 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "POST /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.065651 Aug 03 05:14:54.782627 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-8d87d36d-f251-47d8-a80c-2e7b264c13ba tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:14:54.783204 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-8d87d36d-f251-47d8-a80c-2e7b264c13ba tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 7ee7115a-8a61-415c-a4ba-b53c2aa0c442] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:54.788338 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 126/251] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Aug 3 05:14:54 2022] POST /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442/os-volume_attachments => generated 152 bytes in 92 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 03 05:14:54.804379 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-8d87d36d-f251-47d8-a80c-2e7b264c13ba tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:54.806254 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-8d87d36d-f251-47d8-a80c-2e7b264c13ba tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:54.820329 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-8d87d36d-f251-47d8-a80c-2e7b264c13ba tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:54.824172 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-8d87d36d-f251-47d8-a80c-2e7b264c13ba tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:54.988476 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-0f657e57-e2e1-4239-9943-a90436d024a5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:54.989062 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-0f657e57-e2e1-4239-9943-a90436d024a5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:55.020024 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0f657e57-e2e1-4239-9943-a90436d024a5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:55.022662 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0f657e57-e2e1-4239-9943-a90436d024a5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:55.023658 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0f657e57-e2e1-4239-9943-a90436d024a5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:55.025208 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0f657e57-e2e1-4239-9943-a90436d024a5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:55.127742 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-8d87d36d-f251-47d8-a80c-2e7b264c13ba tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "POST /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442/action" status: 202 len: 0 microversion: 2.1 time: 0.345777 Aug 03 05:14:55.129283 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 126/252] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Aug 3 05:14:54 2022] POST /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442/action => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 05:14:55.142065 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-083f0587-e58b-414a-9cd7-2eb4760f50fe tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:55.147363 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-083f0587-e58b-414a-9cd7-2eb4760f50fe tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 7ee7115a-8a61-415c-a4ba-b53c2aa0c442] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:55.163852 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-083f0587-e58b-414a-9cd7-2eb4760f50fe tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:55.165601 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-083f0587-e58b-414a-9cd7-2eb4760f50fe tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:55.167148 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-083f0587-e58b-414a-9cd7-2eb4760f50fe tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:55.169890 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-083f0587-e58b-414a-9cd7-2eb4760f50fe tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:55.288392 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-0f657e57-e2e1-4239-9943-a90436d024a5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:55.300892 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-0f657e57-e2e1-4239-9943-a90436d024a5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:55.303090 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-0f657e57-e2e1-4239-9943-a90436d024a5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:55.319720 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-0f657e57-e2e1-4239-9943-a90436d024a5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1721 microversion: 2.20 time: 0.321865 Aug 03 05:14:55.321466 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 127/253] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:14:54 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1721 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 05:14:55.357815 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-083f0587-e58b-414a-9cd7-2eb4760f50fe tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:55.369515 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-083f0587-e58b-414a-9cd7-2eb4760f50fe tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442" status: 200 len: 1509 microversion: 2.1 time: 0.235594 Aug 03 05:14:55.370223 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 127/254] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:55 2022] GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442 => generated 1509 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:55.710288 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-567adc13-3a36-4525-af17-b9ce06294333 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:55.710921 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-567adc13-3a36-4525-af17-b9ce06294333 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] [instance: 49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:55.718524 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-567adc13-3a36-4525-af17-b9ce06294333 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:55.718805 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-567adc13-3a36-4525-af17-b9ce06294333 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:55.719838 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-567adc13-3a36-4525-af17-b9ce06294333 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:55.720273 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-567adc13-3a36-4525-af17-b9ce06294333 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:55.861172 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-567adc13-3a36-4525-af17-b9ce06294333 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbb45074cef4d5082580c4c5130eb9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b28cfcd2da41528eb3d71199d3b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:55.870390 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-567adc13-3a36-4525-af17-b9ce06294333 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] 10.222.0.40 "GET /compute/v2.1/servers/49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3" status: 200 len: 1314 microversion: 2.1 time: 0.164481 Aug 03 05:14:55.875856 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 128/255] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:55 2022] GET /compute/v2.1/servers/49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:56.333512 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-d1e5fa1c-3599-4a0e-ba72-c2d82a18d700 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:56.334204 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-d1e5fa1c-3599-4a0e-ba72-c2d82a18d700 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:56.342273 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-d1e5fa1c-3599-4a0e-ba72-c2d82a18d700 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:56.343569 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-d1e5fa1c-3599-4a0e-ba72-c2d82a18d700 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:56.344355 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-d1e5fa1c-3599-4a0e-ba72-c2d82a18d700 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:56.345051 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-d1e5fa1c-3599-4a0e-ba72-c2d82a18d700 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:56.396886 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-d5854f9e-56cc-4199-87c0-63127ee44634 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:56.397580 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-d5854f9e-56cc-4199-87c0-63127ee44634 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 7ee7115a-8a61-415c-a4ba-b53c2aa0c442] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:56.410870 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d5854f9e-56cc-4199-87c0-63127ee44634 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:56.412360 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d5854f9e-56cc-4199-87c0-63127ee44634 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:56.412360 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d5854f9e-56cc-4199-87c0-63127ee44634 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:56.412360 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d5854f9e-56cc-4199-87c0-63127ee44634 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:56.658051 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-d1e5fa1c-3599-4a0e-ba72-c2d82a18d700 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:56.666240 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-d1e5fa1c-3599-4a0e-ba72-c2d82a18d700 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:56.676365 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-d1e5fa1c-3599-4a0e-ba72-c2d82a18d700 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:56.678306 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-d1e5fa1c-3599-4a0e-ba72-c2d82a18d700 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1721 microversion: 2.20 time: 0.348512 Aug 03 05:14:56.678434 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 128/256] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:14:56 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1721 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:14:56.718049 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-d5854f9e-56cc-4199-87c0-63127ee44634 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:56.731050 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-d5854f9e-56cc-4199-87c0-63127ee44634 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442" status: 200 len: 1509 microversion: 2.1 time: 0.342345 Aug 03 05:14:56.736841 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 129/257] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:56 2022] GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442 => generated 1509 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:14:56.892925 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-a23ebde4-2859-4852-8e78-741d62de2bb9 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:56.893548 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-a23ebde4-2859-4852-8e78-741d62de2bb9 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] [instance: 49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:56.906613 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-a23ebde4-2859-4852-8e78-741d62de2bb9 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:56.910754 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-a23ebde4-2859-4852-8e78-741d62de2bb9 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:56.911686 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-a23ebde4-2859-4852-8e78-741d62de2bb9 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:56.912129 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-a23ebde4-2859-4852-8e78-741d62de2bb9 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:57.099281 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-a23ebde4-2859-4852-8e78-741d62de2bb9 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbb45074cef4d5082580c4c5130eb9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b28cfcd2da41528eb3d71199d3b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:57.110529 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-a23ebde4-2859-4852-8e78-741d62de2bb9 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] 10.222.0.40 "GET /compute/v2.1/servers/49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3" status: 200 len: 1314 microversion: 2.1 time: 0.221905 Aug 03 05:14:57.111198 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 129/258] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:56 2022] GET /compute/v2.1/servers/49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:57.706454 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-52e448ad-3485-4294-9bad-ea2a1a898ba5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:57.707160 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-52e448ad-3485-4294-9bad-ea2a1a898ba5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:57.721358 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:14:57.726689 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-52e448ad-3485-4294-9bad-ea2a1a898ba5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:57.728744 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-52e448ad-3485-4294-9bad-ea2a1a898ba5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:57.730482 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-52e448ad-3485-4294-9bad-ea2a1a898ba5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:57.730991 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-52e448ad-3485-4294-9bad-ea2a1a898ba5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:57.767803 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-3b6f83d3-58e2-488f-97e3-0bd9079bc404 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:57.769359 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-3b6f83d3-58e2-488f-97e3-0bd9079bc404 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 7ee7115a-8a61-415c-a4ba-b53c2aa0c442] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:57.792051 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3b6f83d3-58e2-488f-97e3-0bd9079bc404 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:57.793687 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3b6f83d3-58e2-488f-97e3-0bd9079bc404 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:57.797582 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3b6f83d3-58e2-488f-97e3-0bd9079bc404 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:57.797582 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3b6f83d3-58e2-488f-97e3-0bd9079bc404 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:58.194365 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-52e448ad-3485-4294-9bad-ea2a1a898ba5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:58.209625 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-52e448ad-3485-4294-9bad-ea2a1a898ba5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:58.211736 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-3b6f83d3-58e2-488f-97e3-0bd9079bc404 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:58.214048 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-52e448ad-3485-4294-9bad-ea2a1a898ba5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:58.219150 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-52e448ad-3485-4294-9bad-ea2a1a898ba5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1721 microversion: 2.20 time: 0.516330 Aug 03 05:14:58.222439 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 130/259] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:14:57 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1721 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:14:58.236784 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-3b6f83d3-58e2-488f-97e3-0bd9079bc404 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442" status: 200 len: 1509 microversion: 2.1 time: 0.467617 Aug 03 05:14:58.237718 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 130/260] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:57 2022] GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442 => generated 1509 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:58.245953 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-d92b3a43-f3b9-4f17-8472-d32e96219726 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:58.246691 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-d92b3a43-f3b9-4f17-8472-d32e96219726 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] [instance: 49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:58.254488 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d92b3a43-f3b9-4f17-8472-d32e96219726 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:58.259849 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d92b3a43-f3b9-4f17-8472-d32e96219726 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:58.261289 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d92b3a43-f3b9-4f17-8472-d32e96219726 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:58.261897 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d92b3a43-f3b9-4f17-8472-d32e96219726 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:58.696942 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-d92b3a43-f3b9-4f17-8472-d32e96219726 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbb45074cef4d5082580c4c5130eb9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b28cfcd2da41528eb3d71199d3b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:58.709757 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-d92b3a43-f3b9-4f17-8472-d32e96219726 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] 10.222.0.40 "GET /compute/v2.1/servers/49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3" status: 200 len: 1498 microversion: 2.1 time: 0.485348 Aug 03 05:14:58.710651 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 131/261] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:58 2022] GET /compute/v2.1/servers/49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3 => generated 1498 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:59.248513 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-f2b7da48-fcb3-4d0e-b3f6-71b34751e83a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:59.250771 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-f2b7da48-fcb3-4d0e-b3f6-71b34751e83a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:59.265614 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-dcb5b383-2f8d-48f6-a200-bc7209ccb987 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:59.266231 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-dcb5b383-2f8d-48f6-a200-bc7209ccb987 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 7ee7115a-8a61-415c-a4ba-b53c2aa0c442] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:59.273679 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f2b7da48-fcb3-4d0e-b3f6-71b34751e83a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:59.274464 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f2b7da48-fcb3-4d0e-b3f6-71b34751e83a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:59.275323 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f2b7da48-fcb3-4d0e-b3f6-71b34751e83a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:59.279516 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f2b7da48-fcb3-4d0e-b3f6-71b34751e83a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:59.284140 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-dcb5b383-2f8d-48f6-a200-bc7209ccb987 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:59.284140 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-dcb5b383-2f8d-48f6-a200-bc7209ccb987 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:59.284140 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-dcb5b383-2f8d-48f6-a200-bc7209ccb987 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:59.284450 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-dcb5b383-2f8d-48f6-a200-bc7209ccb987 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:00.715240 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-dcb5b383-2f8d-48f6-a200-bc7209ccb987 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:00.726073 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-dcb5b383-2f8d-48f6-a200-bc7209ccb987 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442" status: 200 len: 1509 microversion: 2.1 time: 1.465313 Aug 03 05:15:00.731278 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 132/262] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:59 2022] GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442 => generated 1509 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:00.750289 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-729de2c7-9191-4fd4-9304-10fdc355c544 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:15:00.765504 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-729de2c7-9191-4fd4-9304-10fdc355c544 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:00.766306 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-729de2c7-9191-4fd4-9304-10fdc355c544 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:00.867212 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-f2b7da48-fcb3-4d0e-b3f6-71b34751e83a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:00.891895 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-f2b7da48-fcb3-4d0e-b3f6-71b34751e83a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:00.895565 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-f2b7da48-fcb3-4d0e-b3f6-71b34751e83a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:00.900133 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-f2b7da48-fcb3-4d0e-b3f6-71b34751e83a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1742 microversion: 2.20 time: 1.655881 Aug 03 05:15:00.903908 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 131/263] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:14:59 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1742 bytes in 1660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:15:00.916949 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-b2b3b2b0-7855-4aed-90b2-55af409c846b tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:00.919561 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-b2b3b2b0-7855-4aed-90b2-55af409c846b tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] [instance: 49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:00.929818 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b2b3b2b0-7855-4aed-90b2-55af409c846b tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:00.934728 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b2b3b2b0-7855-4aed-90b2-55af409c846b tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:00.938056 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b2b3b2b0-7855-4aed-90b2-55af409c846b tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:00.938918 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b2b3b2b0-7855-4aed-90b2-55af409c846b tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:00.956575 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-729de2c7-9191-4fd4-9304-10fdc355c544 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Going to try to stop instance {{(pid=118331) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 03 05:15:00.996145 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-b2b3b2b0-7855-4aed-90b2-55af409c846b tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] [instance: 49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3] Going to try to terminate instance {{(pid=118332) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:15:01.251885 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-729de2c7-9191-4fd4-9304-10fdc355c544 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "POST /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5/action" status: 202 len: 0 microversion: 2.1 time: 0.518533 Aug 03 05:15:01.255953 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 133/264] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Aug 3 05:15:00 2022] POST /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5/action => generated 0 bytes in 524 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:15:01.263888 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-9c7db335-4f16-482a-9abc-cf5aa6aa3291 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:01.265025 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-9c7db335-4f16-482a-9abc-cf5aa6aa3291 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:01.272250 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9c7db335-4f16-482a-9abc-cf5aa6aa3291 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:01.272854 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9c7db335-4f16-482a-9abc-cf5aa6aa3291 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:01.275196 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9c7db335-4f16-482a-9abc-cf5aa6aa3291 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:01.275709 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9c7db335-4f16-482a-9abc-cf5aa6aa3291 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:01.439541 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-b2b3b2b0-7855-4aed-90b2-55af409c846b tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] 10.222.0.40 "DELETE /compute/v2.1/servers/49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3" status: 204 len: 0 microversion: 2.1 time: 0.534123 Aug 03 05:15:01.440136 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 132/265] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Aug 3 05:15:00 2022] DELETE /compute/v2.1/servers/49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:15:01.448873 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-c39e7775-2877-41a1-a7ba-82f4d77feef4 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:01.449840 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-c39e7775-2877-41a1-a7ba-82f4d77feef4 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] [instance: 49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:01.458638 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-c39e7775-2877-41a1-a7ba-82f4d77feef4 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:01.459127 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-c39e7775-2877-41a1-a7ba-82f4d77feef4 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:01.459922 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-c39e7775-2877-41a1-a7ba-82f4d77feef4 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:01.460341 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-c39e7775-2877-41a1-a7ba-82f4d77feef4 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:01.651686 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-9c7db335-4f16-482a-9abc-cf5aa6aa3291 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:01.668667 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-9c7db335-4f16-482a-9abc-cf5aa6aa3291 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5" status: 200 len: 1723 microversion: 2.1 time: 0.411246 Aug 03 05:15:01.669777 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 134/266] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:01 2022] GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 => generated 1723 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:01.752697 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-53b4e7c0-26c8-4046-9367-14a963a675d0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:01.753958 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-53b4e7c0-26c8-4046-9367-14a963a675d0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 7ee7115a-8a61-415c-a4ba-b53c2aa0c442] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:01.760947 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-53b4e7c0-26c8-4046-9367-14a963a675d0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:01.761641 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-53b4e7c0-26c8-4046-9367-14a963a675d0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:01.762743 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-53b4e7c0-26c8-4046-9367-14a963a675d0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:01.763395 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-53b4e7c0-26c8-4046-9367-14a963a675d0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:02.055078 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-c39e7775-2877-41a1-a7ba-82f4d77feef4 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbb45074cef4d5082580c4c5130eb9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b28cfcd2da41528eb3d71199d3b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:02.080222 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-c39e7775-2877-41a1-a7ba-82f4d77feef4 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] 10.222.0.40 "GET /compute/v2.1/servers/49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3" status: 200 len: 1504 microversion: 2.1 time: 0.635380 Aug 03 05:15:02.093829 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 133/267] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:01 2022] GET /compute/v2.1/servers/49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3 => generated 1504 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:02.102953 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-d93ec647-ddbf-4e72-97ad-9045ff3d49a3 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:02.103757 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-d93ec647-ddbf-4e72-97ad-9045ff3d49a3 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:02.106090 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:15:02.114349 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-d93ec647-ddbf-4e72-97ad-9045ff3d49a3 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:02.114761 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-d93ec647-ddbf-4e72-97ad-9045ff3d49a3 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:02.115635 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-d93ec647-ddbf-4e72-97ad-9045ff3d49a3 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:02.115992 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-d93ec647-ddbf-4e72-97ad-9045ff3d49a3 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:02.196179 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-53b4e7c0-26c8-4046-9367-14a963a675d0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:02.243429 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-53b4e7c0-26c8-4046-9367-14a963a675d0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442" status: 200 len: 1509 microversion: 2.1 time: 0.483051 Aug 03 05:15:02.243429 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 135/268] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:01 2022] GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442 => generated 1509 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:15:02.646949 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-d93ec647-ddbf-4e72-97ad-9045ff3d49a3 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:02.662174 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-d93ec647-ddbf-4e72-97ad-9045ff3d49a3 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:02.664518 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-d93ec647-ddbf-4e72-97ad-9045ff3d49a3 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:02.667074 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-d93ec647-ddbf-4e72-97ad-9045ff3d49a3 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1742 microversion: 2.20 time: 0.571682 Aug 03 05:15:02.669636 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 134/269] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:15:02 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1742 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:15:02.699994 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-77745789-94e8-441a-9bb7-d1372c723640 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:02.700664 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-77745789-94e8-441a-9bb7-d1372c723640 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:02.713142 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-77745789-94e8-441a-9bb7-d1372c723640 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:02.713612 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-77745789-94e8-441a-9bb7-d1372c723640 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:02.714421 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-77745789-94e8-441a-9bb7-d1372c723640 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:02.716378 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-77745789-94e8-441a-9bb7-d1372c723640 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:02.932980 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [req-ad11c4bf-f310-43e8-a32e-2e4b486d8248 req-b3718d3c-9ec4-4993-ad53-d6c9ad6a5a84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69089938-1d69-415c-8344-e6b9f78f16d1", "name": "network-vif-plugged", "status": "completed", "tag": "602350b3-725c-4735-99e8-acb9b77192fa"}]} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:15:02.952159 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-ad11c4bf-f310-43e8-a32e-2e4b486d8248 req-b3718d3c-9ec4-4993-ad53-d6c9ad6a5a84 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:02.956063 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-ad11c4bf-f310-43e8-a32e-2e4b486d8248 req-b3718d3c-9ec4-4993-ad53-d6c9ad6a5a84 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:02.982106 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.compute.server_external_events [req-ad11c4bf-f310-43e8-a32e-2e4b486d8248 req-b3718d3c-9ec4-4993-ad53-d6c9ad6a5a84 service nova] Creating event network-vif-plugged:602350b3-725c-4735-99e8-acb9b77192fa for instance 69089938-1d69-415c-8344-e6b9f78f16d1 on hv-cinder-85127 Aug 03 05:15:02.989612 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [req-ad11c4bf-f310-43e8-a32e-2e4b486d8248 req-b3718d3c-9ec4-4993-ad53-d6c9ad6a5a84 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060956 Aug 03 05:15:02.989757 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-77745789-94e8-441a-9bb7-d1372c723640 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:02.991780 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 135/270] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:15:03.001207 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-77745789-94e8-441a-9bb7-d1372c723640 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5" status: 200 len: 1723 microversion: 2.1 time: 0.311814 Aug 03 05:15:03.005841 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 136/271] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:02 2022] GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 => generated 1723 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:03.105342 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-0763dde4-56c4-464d-b91a-d4ebfd94f2c6 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:03.106709 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-0763dde4-56c4-464d-b91a-d4ebfd94f2c6 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] [instance: 49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:03.119036 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-0763dde4-56c4-464d-b91a-d4ebfd94f2c6 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:03.119036 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-0763dde4-56c4-464d-b91a-d4ebfd94f2c6 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:03.119036 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-0763dde4-56c4-464d-b91a-d4ebfd94f2c6 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:03.119578 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-0763dde4-56c4-464d-b91a-d4ebfd94f2c6 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:03.253932 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-680bb6b6-5b8d-4d70-bbe9-21fb4dc695a6 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:03.254935 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-680bb6b6-5b8d-4d70-bbe9-21fb4dc695a6 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 7ee7115a-8a61-415c-a4ba-b53c2aa0c442] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:03.270670 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-680bb6b6-5b8d-4d70-bbe9-21fb4dc695a6 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:03.271440 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-680bb6b6-5b8d-4d70-bbe9-21fb4dc695a6 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:03.276181 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-680bb6b6-5b8d-4d70-bbe9-21fb4dc695a6 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:03.276181 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-680bb6b6-5b8d-4d70-bbe9-21fb4dc695a6 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:03.728719 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-0763dde4-56c4-464d-b91a-d4ebfd94f2c6 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbb45074cef4d5082580c4c5130eb9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b28cfcd2da41528eb3d71199d3b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:03.739252 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-0763dde4-56c4-464d-b91a-d4ebfd94f2c6 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] 10.222.0.40 "GET /compute/v2.1/servers/49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3" status: 200 len: 1504 microversion: 2.1 time: 0.639383 Aug 03 05:15:03.739851 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 136/272] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:03 2022] GET /compute/v2.1/servers/49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3 => generated 1504 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:03.749881 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-55ce97e6-89fb-4670-b83a-7d254b50cb96 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:03.753498 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-55ce97e6-89fb-4670-b83a-7d254b50cb96 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:03.762634 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-55ce97e6-89fb-4670-b83a-7d254b50cb96 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:03.763200 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-55ce97e6-89fb-4670-b83a-7d254b50cb96 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:03.765635 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-55ce97e6-89fb-4670-b83a-7d254b50cb96 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:03.766898 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-55ce97e6-89fb-4670-b83a-7d254b50cb96 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:03.877962 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-680bb6b6-5b8d-4d70-bbe9-21fb4dc695a6 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:03.903589 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-680bb6b6-5b8d-4d70-bbe9-21fb4dc695a6 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442" status: 200 len: 1509 microversion: 2.1 time: 0.655627 Aug 03 05:15:03.905303 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 137/273] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:03 2022] GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442 => generated 1509 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:15:04.023832 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-f72cdd64-bacb-4269-ac1e-18bc9c4dc649 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:04.025509 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-f72cdd64-bacb-4269-ac1e-18bc9c4dc649 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:04.041801 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f72cdd64-bacb-4269-ac1e-18bc9c4dc649 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:04.050687 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f72cdd64-bacb-4269-ac1e-18bc9c4dc649 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:04.051901 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f72cdd64-bacb-4269-ac1e-18bc9c4dc649 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:04.052533 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f72cdd64-bacb-4269-ac1e-18bc9c4dc649 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:04.110880 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-55ce97e6-89fb-4670-b83a-7d254b50cb96 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:04.115762 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:15:04.121443 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-55ce97e6-89fb-4670-b83a-7d254b50cb96 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:04.137104 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-55ce97e6-89fb-4670-b83a-7d254b50cb96 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:04.143911 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-55ce97e6-89fb-4670-b83a-7d254b50cb96 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1742 microversion: 2.20 time: 0.395188 Aug 03 05:15:04.146945 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 137/274] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:15:03 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1742 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:15:04.474370 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-f72cdd64-bacb-4269-ac1e-18bc9c4dc649 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:04.483544 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-f72cdd64-bacb-4269-ac1e-18bc9c4dc649 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5" status: 200 len: 1723 microversion: 2.1 time: 0.464658 Aug 03 05:15:04.493532 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 138/275] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:04 2022] GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 => generated 1723 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:15:04.760542 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-72b48bf7-ed3a-4759-894c-e2c05f4045df tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:04.761506 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-72b48bf7-ed3a-4759-894c-e2c05f4045df tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] [instance: 49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:04.772514 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-72b48bf7-ed3a-4759-894c-e2c05f4045df tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:04.773252 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-72b48bf7-ed3a-4759-894c-e2c05f4045df tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:04.774052 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-72b48bf7-ed3a-4759-894c-e2c05f4045df tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:04.781795 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-72b48bf7-ed3a-4759-894c-e2c05f4045df tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:04.935564 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-3d12e057-a0d6-43e2-96ed-5b4c79c9fdb3 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:04.936745 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-3d12e057-a0d6-43e2-96ed-5b4c79c9fdb3 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 7ee7115a-8a61-415c-a4ba-b53c2aa0c442] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:04.949380 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3d12e057-a0d6-43e2-96ed-5b4c79c9fdb3 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:04.953300 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3d12e057-a0d6-43e2-96ed-5b4c79c9fdb3 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:04.956666 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3d12e057-a0d6-43e2-96ed-5b4c79c9fdb3 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:04.957298 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3d12e057-a0d6-43e2-96ed-5b4c79c9fdb3 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:05.179965 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-72b48bf7-ed3a-4759-894c-e2c05f4045df tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbb45074cef4d5082580c4c5130eb9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b28cfcd2da41528eb3d71199d3b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:05.191885 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-72b48bf7-ed3a-4759-894c-e2c05f4045df tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] 10.222.0.40 "GET /compute/v2.1/servers/49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3" status: 200 len: 1504 microversion: 2.1 time: 0.434921 Aug 03 05:15:05.193407 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 138/276] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:04 2022] GET /compute/v2.1/servers/49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3 => generated 1504 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:05.200464 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-75f3ccd1-be0e-46e5-8767-6ad021b4b09e tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:05.203403 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-75f3ccd1-be0e-46e5-8767-6ad021b4b09e tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:05.210952 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-75f3ccd1-be0e-46e5-8767-6ad021b4b09e tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:05.213279 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-75f3ccd1-be0e-46e5-8767-6ad021b4b09e tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:05.214231 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-75f3ccd1-be0e-46e5-8767-6ad021b4b09e tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:05.218037 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-75f3ccd1-be0e-46e5-8767-6ad021b4b09e tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:06.453733 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-3d12e057-a0d6-43e2-96ed-5b4c79c9fdb3 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:06.465170 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-3d12e057-a0d6-43e2-96ed-5b4c79c9fdb3 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442" status: 200 len: 1515 microversion: 2.1 time: 1.535310 Aug 03 05:15:06.474380 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 139/277] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:04 2022] GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442 => generated 1515 bytes in 1547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:06.489016 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-3955a647-5631-4cec-9341-40314aa72d5a tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:06.490445 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-3955a647-5631-4cec-9341-40314aa72d5a tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:06.500981 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3955a647-5631-4cec-9341-40314aa72d5a tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:06.501586 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3955a647-5631-4cec-9341-40314aa72d5a tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:06.502499 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3955a647-5631-4cec-9341-40314aa72d5a tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:06.503277 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3955a647-5631-4cec-9341-40314aa72d5a tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:06.628416 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-75f3ccd1-be0e-46e5-8767-6ad021b4b09e tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:06.638727 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-75f3ccd1-be0e-46e5-8767-6ad021b4b09e tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:06.647546 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-75f3ccd1-be0e-46e5-8767-6ad021b4b09e tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:06.649436 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-75f3ccd1-be0e-46e5-8767-6ad021b4b09e tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1742 microversion: 2.20 time: 1.454389 Aug 03 05:15:06.650289 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 139/278] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:15:05 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1742 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:15:06.660920 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-56832d1b-cdad-4324-862d-9e4bcf2f6279 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:06.670138 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-56832d1b-cdad-4324-862d-9e4bcf2f6279 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] [instance: 49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:06.676989 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-56832d1b-cdad-4324-862d-9e4bcf2f6279 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:06.677583 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-56832d1b-cdad-4324-862d-9e4bcf2f6279 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:06.679721 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-56832d1b-cdad-4324-862d-9e4bcf2f6279 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:06.680434 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-56832d1b-cdad-4324-862d-9e4bcf2f6279 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:07.349911 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-3955a647-5631-4cec-9341-40314aa72d5a tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:07.362305 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-3955a647-5631-4cec-9341-40314aa72d5a tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5" status: 200 len: 1723 microversion: 2.1 time: 0.885393 Aug 03 05:15:07.362978 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 140/279] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:06 2022] GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 => generated 1723 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:07.675989 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-82069fb7-6e1b-4fdc-bc2f-9f678baa570c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:07.676684 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-82069fb7-6e1b-4fdc-bc2f-9f678baa570c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:07.700917 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-82069fb7-6e1b-4fdc-bc2f-9f678baa570c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:07.703598 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-82069fb7-6e1b-4fdc-bc2f-9f678baa570c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:07.708441 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-82069fb7-6e1b-4fdc-bc2f-9f678baa570c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:07.709348 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-82069fb7-6e1b-4fdc-bc2f-9f678baa570c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:07.758111 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-56832d1b-cdad-4324-862d-9e4bcf2f6279 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbb45074cef4d5082580c4c5130eb9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b28cfcd2da41528eb3d71199d3b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:07.771205 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-56832d1b-cdad-4324-862d-9e4bcf2f6279 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] 10.222.0.40 "GET /compute/v2.1/servers/49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3" status: 200 len: 1504 microversion: 2.1 time: 1.118808 Aug 03 05:15:07.775506 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 140/280] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:06 2022] GET /compute/v2.1/servers/49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3 => generated 1504 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:08.389690 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-4359dcae-b279-47e9-8198-0f339af3eb2c tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:08.390137 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-4359dcae-b279-47e9-8198-0f339af3eb2c tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:08.410230 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-4359dcae-b279-47e9-8198-0f339af3eb2c tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:08.411463 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-4359dcae-b279-47e9-8198-0f339af3eb2c tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:08.413722 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-4359dcae-b279-47e9-8198-0f339af3eb2c tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:08.416815 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-4359dcae-b279-47e9-8198-0f339af3eb2c tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:09.103931 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-82069fb7-6e1b-4fdc-bc2f-9f678baa570c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:09.108857 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:15:09.125160 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-82069fb7-6e1b-4fdc-bc2f-9f678baa570c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:09.130335 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-82069fb7-6e1b-4fdc-bc2f-9f678baa570c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:09.133070 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-82069fb7-6e1b-4fdc-bc2f-9f678baa570c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1737 microversion: 2.20 time: 1.461012 Aug 03 05:15:09.135150 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 141/281] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:15:07 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1737 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:15:09.562073 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-4359dcae-b279-47e9-8198-0f339af3eb2c tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:09.579567 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-4359dcae-b279-47e9-8198-0f339af3eb2c tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5" status: 200 len: 1723 microversion: 2.1 time: 1.195623 Aug 03 05:15:09.582968 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 141/282] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:08 2022] GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 => generated 1723 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:09.591009 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-e7cd7e87-a088-4614-a0d3-40130e496428 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:09.593212 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-e7cd7e87-a088-4614-a0d3-40130e496428 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] [instance: 49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:09.615717 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e7cd7e87-a088-4614-a0d3-40130e496428 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:09.621391 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e7cd7e87-a088-4614-a0d3-40130e496428 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:09.626322 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e7cd7e87-a088-4614-a0d3-40130e496428 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:09.627233 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e7cd7e87-a088-4614-a0d3-40130e496428 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:09.752360 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-e7cd7e87-a088-4614-a0d3-40130e496428 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbb45074cef4d5082580c4c5130eb9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b28cfcd2da41528eb3d71199d3b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:09.764791 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-e7cd7e87-a088-4614-a0d3-40130e496428 tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] 10.222.0.40 "GET /compute/v2.1/servers/49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3" status: 200 len: 1462 microversion: 2.1 time: 0.177153 Aug 03 05:15:09.768487 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 142/283] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:09 2022] GET /compute/v2.1/servers/49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3 => generated 1462 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:09.797032 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-5c460fc8-1545-47af-975e-112914d9f98d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Action: 'create', calling method: .version_select at 0x7f7602217550>, body: {"keypair": {"name": "tempest-keypair-992538248", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLlbkOETtuhaa/0uuyFUztfFcnKqb5t+tIaDCNdSolNzpd4nYRRddBPOWnbztJlHILYfgZ/zrj0NnD6V11w/Hio3f4DsvdLIhIs7q+rSbaIZkQVZN6gcwsT14j7lPh2paA=="}} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:15:09.851116 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.quota [None req-5c460fc8-1545-47af-975e-112914d9f98d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Getting quotas for project 829c8e80e96d40d682a17185eb4da336. Resources: {'key_pairs'} {{(pid=118332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:15:09.870982 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.quota [None req-5c460fc8-1545-47af-975e-112914d9f98d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Getting quotas for user bb0fe4cb98e0447cad3e126da1a8de9c and project 829c8e80e96d40d682a17185eb4da336. Resources: {'key_pairs'} {{(pid=118332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:15:09.874622 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-c4f61a22-f938-4fdd-ad44-145f7d4a1003 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Action: 'create', calling method: .version_select at 0x7f76028369d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1654296735", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPsNIGgDhPGY/kJB8/Yy0BmTiyFgV456fh4DLrz7c96w4SNJV5ffthpsxMJIZOKS7Uoq5WoCGDjGPV5J5/nUGj+ShJEMXuHkvd6yB67mtixBGZMGmy1tQzE+VR4t+BDKA=="}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:15:09.922686 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-c4f61a22-f938-4fdd-ad44-145f7d4a1003 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Getting quotas for project 6ff6f2c611f44256a7d85a8d99981d9d. Resources: {'key_pairs'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:15:09.933162 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-c4f61a22-f938-4fdd-ad44-145f7d4a1003 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Getting quotas for user f145cffb3c4d4965a35553b95b316f56 and project 6ff6f2c611f44256a7d85a8d99981d9d. Resources: {'key_pairs'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:15:10.001861 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-5c460fc8-1545-47af-975e-112914d9f98d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.214417 Aug 03 05:15:10.002898 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 143/284] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Aug 3 05:15:09 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:15:10.041231 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [req-90b0c3a6-25cc-4b5b-b0dc-dad44d4e8203 req-0bcad8f1-1724-4b23-9796-0a456758ce3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3", "name": "network-vif-unplugged", "status": "completed", "tag": "f2ab039a-8219-434d-9b4b-67e3c8ffc9ba"}]} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:15:10.065922 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-90b0c3a6-25cc-4b5b-b0dc-dad44d4e8203 req-0bcad8f1-1724-4b23-9796-0a456758ce3e service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:10.066938 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-90b0c3a6-25cc-4b5b-b0dc-dad44d4e8203 req-0bcad8f1-1724-4b23-9796-0a456758ce3e service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:10.106290 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.compute.server_external_events [req-90b0c3a6-25cc-4b5b-b0dc-dad44d4e8203 req-0bcad8f1-1724-4b23-9796-0a456758ce3e service nova] Creating event network-vif-unplugged:f2ab039a-8219-434d-9b4b-67e3c8ffc9ba for instance 49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3 on hv-cinder-85127 Aug 03 05:15:10.118943 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [req-90b0c3a6-25cc-4b5b-b0dc-dad44d4e8203 req-0bcad8f1-1724-4b23-9796-0a456758ce3e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100339 Aug 03 05:15:10.120075 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 144/285] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:15:10.132635 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [req-346ed4d8-d810-4562-bb21-0d4cba87d93a req-51ffafbc-b0d8-4154-b2c8-51360757f7d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3", "name": "network-vif-deleted", "tag": "f2ab039a-8219-434d-9b4b-67e3c8ffc9ba"}]} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:15:10.152840 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-346ed4d8-d810-4562-bb21-0d4cba87d93a req-51ffafbc-b0d8-4154-b2c8-51360757f7d9 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:10.153284 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-346ed4d8-d810-4562-bb21-0d4cba87d93a req-51ffafbc-b0d8-4154-b2c8-51360757f7d9 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:10.160883 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-c4f61a22-f938-4fdd-ad44-145f7d4a1003 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 1.024448 Aug 03 05:15:10.161496 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 142/286] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Aug 3 05:15:09 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:15:10.178349 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-899e68d2-0681-4cdf-983f-d332be16ea77 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:10.182376 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-899e68d2-0681-4cdf-983f-d332be16ea77 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:10.219294 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-899e68d2-0681-4cdf-983f-d332be16ea77 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:10.219767 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-899e68d2-0681-4cdf-983f-d332be16ea77 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:10.220589 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-899e68d2-0681-4cdf-983f-d332be16ea77 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:10.220996 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-899e68d2-0681-4cdf-983f-d332be16ea77 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:10.228874 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.compute.server_external_events [req-346ed4d8-d810-4562-bb21-0d4cba87d93a req-51ffafbc-b0d8-4154-b2c8-51360757f7d9 service nova] Creating event network-vif-deleted:f2ab039a-8219-434d-9b4b-67e3c8ffc9ba for instance 49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3 on hv-cinder-85127 Aug 03 05:15:10.261249 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [req-346ed4d8-d810-4562-bb21-0d4cba87d93a req-51ffafbc-b0d8-4154-b2c8-51360757f7d9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139275 Aug 03 05:15:10.267700 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 145/287] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:15:10.602987 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-10ecabdd-34f3-4f00-85e6-327e0f1dd818 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:10.603678 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-10ecabdd-34f3-4f00-85e6-327e0f1dd818 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:10.619484 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-10ecabdd-34f3-4f00-85e6-327e0f1dd818 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:10.642065 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-10ecabdd-34f3-4f00-85e6-327e0f1dd818 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:10.643762 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-10ecabdd-34f3-4f00-85e6-327e0f1dd818 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:10.644405 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-10ecabdd-34f3-4f00-85e6-327e0f1dd818 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:10.898099 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-899e68d2-0681-4cdf-983f-d332be16ea77 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:10.911245 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-899e68d2-0681-4cdf-983f-d332be16ea77 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:10.919230 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-899e68d2-0681-4cdf-983f-d332be16ea77 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:10.921209 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-899e68d2-0681-4cdf-983f-d332be16ea77 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1737 microversion: 2.20 time: 0.758169 Aug 03 05:15:10.925623 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 143/288] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:15:10 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1737 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:15:10.943812 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-9bb70cb9-beba-4d4b-afb4-704cc49b808a tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:10.944751 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-9bb70cb9-beba-4d4b-afb4-704cc49b808a tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] [instance: 49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:10.974935 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9bb70cb9-beba-4d4b-afb4-704cc49b808a tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:10.981656 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9bb70cb9-beba-4d4b-afb4-704cc49b808a tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:10.983280 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9bb70cb9-beba-4d4b-afb4-704cc49b808a tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:10.987315 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9bb70cb9-beba-4d4b-afb4-704cc49b808a tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:11.103774 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9bb70cb9-beba-4d4b-afb4-704cc49b808a tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:11.104222 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9bb70cb9-beba-4d4b-afb4-704cc49b808a tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:11.108365 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.objects.instance [None req-9bb70cb9-beba-4d4b-afb4-704cc49b808a tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lazy-loading 'fault' on Instance uuid 49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3 {{(pid=118331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:15:11.183323 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-10ecabdd-34f3-4f00-85e6-327e0f1dd818 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:11.200523 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-10ecabdd-34f3-4f00-85e6-327e0f1dd818 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5" status: 200 len: 1723 microversion: 2.1 time: 0.601865 Aug 03 05:15:11.201907 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 146/289] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:10 2022] GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 => generated 1723 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:15:11.252111 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-9bb70cb9-beba-4d4b-afb4-704cc49b808a tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbb45074cef4d5082580c4c5130eb9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b28cfcd2da41528eb3d71199d3b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:11.269801 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-9bb70cb9-beba-4d4b-afb4-704cc49b808a tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] 10.222.0.40 "GET /compute/v2.1/servers/49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3" status: 200 len: 1304 microversion: 2.1 time: 0.340420 Aug 03 05:15:11.271112 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 144/290] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:10 2022] GET /compute/v2.1/servers/49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3 => generated 1304 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:11.956765 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-12f735a5-ec07-41fb-9171-1e9f61782370 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:11.957414 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-12f735a5-ec07-41fb-9171-1e9f61782370 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:11.966130 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-12f735a5-ec07-41fb-9171-1e9f61782370 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:11.967491 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-12f735a5-ec07-41fb-9171-1e9f61782370 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:11.977236 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-12f735a5-ec07-41fb-9171-1e9f61782370 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:11.977693 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-12f735a5-ec07-41fb-9171-1e9f61782370 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:12.185043 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-12f735a5-ec07-41fb-9171-1e9f61782370 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:12.202509 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-12f735a5-ec07-41fb-9171-1e9f61782370 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:12.204811 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-12f735a5-ec07-41fb-9171-1e9f61782370 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:12.206644 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-12f735a5-ec07-41fb-9171-1e9f61782370 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1737 microversion: 2.20 time: 0.253622 Aug 03 05:15:12.208789 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 147/291] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:15:11 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1737 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:15:12.226685 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-750fb0ca-81cc-4be2-966e-e44e48cea168 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:12.227483 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-750fb0ca-81cc-4be2-966e-e44e48cea168 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:12.245528 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-750fb0ca-81cc-4be2-966e-e44e48cea168 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:12.246295 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-750fb0ca-81cc-4be2-966e-e44e48cea168 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:12.247316 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-750fb0ca-81cc-4be2-966e-e44e48cea168 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:12.248509 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-750fb0ca-81cc-4be2-966e-e44e48cea168 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:12.300541 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-ced76ccb-1c2c-4c91-983b-0034f87bf47a tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:12.301306 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-ced76ccb-1c2c-4c91-983b-0034f87bf47a tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] [instance: 49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:12.353368 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-ced76ccb-1c2c-4c91-983b-0034f87bf47a tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:12.354885 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-ced76ccb-1c2c-4c91-983b-0034f87bf47a tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:12.357028 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-ced76ccb-1c2c-4c91-983b-0034f87bf47a tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:12.359711 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-ced76ccb-1c2c-4c91-983b-0034f87bf47a tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:12.425807 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.wsgi [None req-ced76ccb-1c2c-4c91-983b-0034f87bf47a tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] HTTP exception thrown: Instance 49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3 could not be found. Aug 03 05:15:12.425807 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-ced76ccb-1c2c-4c91-983b-0034f87bf47a tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Request method failure captured: Aug 03 05:15:12.425807 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: request: GET /compute/v2.1/servers/49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3 HTTP/1.1 Aug 03 05:15:12.425807 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Accept: application/json Aug 03 05:15:12.425807 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Accept-Encoding: identity Aug 03 05:15:12.425807 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Connection: close Aug 03 05:15:12.425807 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Content-Length: 0 Aug 03 05:15:12.425807 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Content-Type: application/json Aug 03 05:15:12.425807 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Host: 10.222.0.40 Aug 03 05:15:12.425807 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Openstack-System-Scope: None Aug 03 05:15:12.425807 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: User-Agent: python-urllib3/1.26.10 Aug 03 05:15:12.425807 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Auth-Token: gAAAAABi6gQcTGOHWy2MPmIrCIoE8ta_1b1Cznzh4obwkGMOZRLXyuy3iACGP2rq4ex0_dlV_cJzhK_R4EFisXJhDCCiTx_8PFdlvgJ_KmZ8LydOs7QkTnxh8l5TLTa9clJEArq0hX8kpNGOIYMBupCymsdMH_3MjEoMydVOctkELZ0R5KuCg9I Aug 03 05:15:12.425807 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Domain-Id: None Aug 03 05:15:12.425807 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Domain-Name: None Aug 03 05:15:12.425807 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Identity-Status: Confirmed Aug 03 05:15:12.425807 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Is-Admin-Project: True Aug 03 05:15:12.425807 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Domain-Id: default Aug 03 05:15:12.425807 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Domain-Name: Default Aug 03 05:15:12.425807 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Id: d9b28cfcd2da41528eb3d71199d3b2d9 Aug 03 05:15:12.425807 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Name: tempest-VolumesActionsTest-314457804 Aug 03 05:15:12.425807 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Role: member,reader Aug 03 05:15:12.425807 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Roles: member,reader Aug 03 05:15:12.427593 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d9b28cfcd2da41528eb3d71199d3b2d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d9b28cfcd2da41528eb3d71199d3b2d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d9b28cfcd2da41528eb3d71199d3b2d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d9b28cfcd2da41528eb3d71199d3b2d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:15:12.427593 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant: tempest-VolumesActionsTest-314457804 Aug 03 05:15:12.427593 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant-Id: d9b28cfcd2da41528eb3d71199d3b2d9 Aug 03 05:15:12.427593 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant-Name: tempest-VolumesActionsTest-314457804 Aug 03 05:15:12.427593 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User: tempest-VolumesActionsTest-314457804-project Aug 03 05:15:12.427593 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Domain-Id: default Aug 03 05:15:12.427593 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Domain-Name: Default Aug 03 05:15:12.427593 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Id: 8cbb45074cef4d5082580c4c5130eb9a Aug 03 05:15:12.427593 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Name: tempest-VolumesActionsTest-314457804-project Aug 03 05:15:12.427593 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: method: > Aug 03 05:15:12.427593 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: exception: Instance 49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3 could not be found. Aug 03 05:15:12.427593 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: action_args: {'id': '49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3'} Aug 03 05:15:12.428463 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:15:12.428463 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:15:12.428463 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:15:12.428463 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:15:12.428463 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:15:12.428463 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:15:12.428463 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:15:12.428463 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:15:12.428463 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:15:12.428463 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:15:12.428463 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3 could not be found. Aug 03 05:15:12.428463 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:15:12.428463 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:15:12.428463 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:15:12.428463 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:15:12.428463 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:15:12.428463 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:15:12.428463 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:15:12.428463 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:15:12.428463 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:15:12.429857 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:15:12.429857 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:15:12.429857 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:15:12.429857 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:15:12.429857 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:15:12.429857 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:15:12.429857 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:15:12.429857 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3 could not be found. Aug 03 05:15:12.429857 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:15:12.429857 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:15:12.429857 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:15:12.429857 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:15:12.429857 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:15:12.429857 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:15:12.429857 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:15:12.429857 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:15:12.429857 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3 could not be found. Aug 03 05:15:12.429857 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:15:12.432963 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-ced76ccb-1c2c-4c91-983b-0034f87bf47a tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] Returning 404 to user: Instance 49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3 could not be found. {{(pid=118332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:15:12.432963 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-ced76ccb-1c2c-4c91-983b-0034f87bf47a tempest-VolumesActionsTest-314457804 tempest-VolumesActionsTest-314457804-project] 10.222.0.40 "GET /compute/v2.1/servers/49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3" status: 404 len: 111 microversion: 2.1 time: 0.136223 Aug 03 05:15:12.432963 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 148/292] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:12 2022] GET /compute/v2.1/servers/49c4dfe0-7908-4201-bf5e-5d0f03a5e6a3 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 05:15:12.665269 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-750fb0ca-81cc-4be2-966e-e44e48cea168 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:12.695138 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-750fb0ca-81cc-4be2-966e-e44e48cea168 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5" status: 200 len: 1723 microversion: 2.1 time: 0.475099 Aug 03 05:15:12.697349 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 145/293] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:12 2022] GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 => generated 1723 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:13.234454 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-69b23d4c-ffe6-4ad0-af13-11091c212642 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:13.235668 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-69b23d4c-ffe6-4ad0-af13-11091c212642 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:13.248933 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-69b23d4c-ffe6-4ad0-af13-11091c212642 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:13.250803 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-69b23d4c-ffe6-4ad0-af13-11091c212642 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:13.252430 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-69b23d4c-ffe6-4ad0-af13-11091c212642 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:13.253482 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-69b23d4c-ffe6-4ad0-af13-11091c212642 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:13.726545 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-46ee9be2-d62c-4685-8e39-2437dd5bffcf tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:13.727168 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-46ee9be2-d62c-4685-8e39-2437dd5bffcf tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:13.756023 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-46ee9be2-d62c-4685-8e39-2437dd5bffcf tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:13.761655 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-46ee9be2-d62c-4685-8e39-2437dd5bffcf tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:13.776065 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-46ee9be2-d62c-4685-8e39-2437dd5bffcf tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:13.776887 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-46ee9be2-d62c-4685-8e39-2437dd5bffcf tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:14.280389 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-46ee9be2-d62c-4685-8e39-2437dd5bffcf tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:14.301581 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-69b23d4c-ffe6-4ad0-af13-11091c212642 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:14.303560 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-46ee9be2-d62c-4685-8e39-2437dd5bffcf tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5" status: 200 len: 1723 microversion: 2.1 time: 0.577643 Aug 03 05:15:14.308991 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 146/294] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:13 2022] GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 => generated 1723 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:14.338360 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-69b23d4c-ffe6-4ad0-af13-11091c212642 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:14.347058 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-69b23d4c-ffe6-4ad0-af13-11091c212642 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:14.356544 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-69b23d4c-ffe6-4ad0-af13-11091c212642 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1737 microversion: 2.20 time: 1.126945 Aug 03 05:15:14.360821 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 149/295] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:15:13 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1737 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:15:15.333935 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-d6d3cca9-6f03-4f02-8dfb-dcbc127f5597 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:15.335256 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-d6d3cca9-6f03-4f02-8dfb-dcbc127f5597 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:15.351621 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d6d3cca9-6f03-4f02-8dfb-dcbc127f5597 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:15.358826 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d6d3cca9-6f03-4f02-8dfb-dcbc127f5597 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:15.361001 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d6d3cca9-6f03-4f02-8dfb-dcbc127f5597 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:15.361679 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d6d3cca9-6f03-4f02-8dfb-dcbc127f5597 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:15.398124 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-34149072-434a-47ad-a68a-fd6aa52d8c66 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:15.399459 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-34149072-434a-47ad-a68a-fd6aa52d8c66 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:15.411700 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-34149072-434a-47ad-a68a-fd6aa52d8c66 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:15.413495 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-34149072-434a-47ad-a68a-fd6aa52d8c66 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:15.413495 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-34149072-434a-47ad-a68a-fd6aa52d8c66 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:15.413966 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-34149072-434a-47ad-a68a-fd6aa52d8c66 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:15.921119 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-d6d3cca9-6f03-4f02-8dfb-dcbc127f5597 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:15.932152 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-d6d3cca9-6f03-4f02-8dfb-dcbc127f5597 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5" status: 200 len: 1723 microversion: 2.1 time: 0.600423 Aug 03 05:15:15.936480 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 147/296] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:15 2022] GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 => generated 1723 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:15.954563 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-34149072-434a-47ad-a68a-fd6aa52d8c66 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:15.973220 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-34149072-434a-47ad-a68a-fd6aa52d8c66 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:15.975722 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-34149072-434a-47ad-a68a-fd6aa52d8c66 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:15.977505 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-34149072-434a-47ad-a68a-fd6aa52d8c66 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1737 microversion: 2.20 time: 0.583035 Aug 03 05:15:15.978253 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 150/297] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:15:15 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1737 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:15:16.689557 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-b9eb7a08-3591-4cc7-83f7-def80fc0932d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-535200871", "imageRef": "37d7ad4a-d925-48e6-84af-ec878f19050e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2e69d8c5-66e7-4f9d-9779-ca17893c6637"}], "security_groups": [{"name": "tempest-securitygroup--528471934"}], "key_name": "tempest-keypair-992538248", "user_data": "}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:15:16.957351 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-5b3373fb-6c0b-48c2-a4ba-40ab6e355cc2 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:16.957965 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-5b3373fb-6c0b-48c2-a4ba-40ab6e355cc2 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:16.968375 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-5b3373fb-6c0b-48c2-a4ba-40ab6e355cc2 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:16.978185 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-5b3373fb-6c0b-48c2-a4ba-40ab6e355cc2 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:16.978185 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-5b3373fb-6c0b-48c2-a4ba-40ab6e355cc2 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:16.978185 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-5b3373fb-6c0b-48c2-a4ba-40ab6e355cc2 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:17.245660 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-5b3373fb-6c0b-48c2-a4ba-40ab6e355cc2 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:17.255340 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-5b3373fb-6c0b-48c2-a4ba-40ab6e355cc2 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5" status: 200 len: 1723 microversion: 2.1 time: 0.302184 Aug 03 05:15:17.256270 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 151/298] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:16 2022] GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 => generated 1723 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:17.263073 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-381a036c-68bf-4ebd-aae2-bfccabd6abec tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:17.275205 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-381a036c-68bf-4ebd-aae2-bfccabd6abec tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:17.300998 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-381a036c-68bf-4ebd-aae2-bfccabd6abec tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:17.301498 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-381a036c-68bf-4ebd-aae2-bfccabd6abec tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:17.307482 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-381a036c-68bf-4ebd-aae2-bfccabd6abec tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:17.308378 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-381a036c-68bf-4ebd-aae2-bfccabd6abec tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:17.652998 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-381a036c-68bf-4ebd-aae2-bfccabd6abec tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:17.695017 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-381a036c-68bf-4ebd-aae2-bfccabd6abec tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:17.695017 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-381a036c-68bf-4ebd-aae2-bfccabd6abec tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:17.695017 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-381a036c-68bf-4ebd-aae2-bfccabd6abec tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1737 microversion: 2.20 time: 0.422627 Aug 03 05:15:17.695423 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 152/299] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:15:17 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1737 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:15:18.280207 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-e1cef1d7-2147-4d11-8793-66af6c3d807e tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:18.280985 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-e1cef1d7-2147-4d11-8793-66af6c3d807e tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:18.290590 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e1cef1d7-2147-4d11-8793-66af6c3d807e tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:18.293006 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e1cef1d7-2147-4d11-8793-66af6c3d807e tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:18.294003 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e1cef1d7-2147-4d11-8793-66af6c3d807e tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:18.295761 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e1cef1d7-2147-4d11-8793-66af6c3d807e tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:18.670019 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-e1cef1d7-2147-4d11-8793-66af6c3d807e tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:18.693945 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-e1cef1d7-2147-4d11-8793-66af6c3d807e tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5" status: 200 len: 1723 microversion: 2.1 time: 0.417962 Aug 03 05:15:18.695637 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 153/300] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:18 2022] GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 => generated 1723 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:15:18.715293 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-eb98a59d-fa4f-478c-98ef-f6fc085fefd5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:18.717041 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-eb98a59d-fa4f-478c-98ef-f6fc085fefd5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:18.728628 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-eb98a59d-fa4f-478c-98ef-f6fc085fefd5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:18.728628 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-eb98a59d-fa4f-478c-98ef-f6fc085fefd5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:18.728628 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-eb98a59d-fa4f-478c-98ef-f6fc085fefd5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:18.728628 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-eb98a59d-fa4f-478c-98ef-f6fc085fefd5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:18.977785 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-eb98a59d-fa4f-478c-98ef-f6fc085fefd5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:18.989511 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-eb98a59d-fa4f-478c-98ef-f6fc085fefd5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:18.992303 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-eb98a59d-fa4f-478c-98ef-f6fc085fefd5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:18.993614 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-eb98a59d-fa4f-478c-98ef-f6fc085fefd5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1737 microversion: 2.20 time: 0.289444 Aug 03 05:15:18.994309 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 154/301] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:15:18 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1737 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:15:19.722913 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-745cee8a-7098-4420-b254-857b7dcba665 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:19.724143 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-745cee8a-7098-4420-b254-857b7dcba665 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:19.738805 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-745cee8a-7098-4420-b254-857b7dcba665 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:19.739431 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-745cee8a-7098-4420-b254-857b7dcba665 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:19.740233 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-745cee8a-7098-4420-b254-857b7dcba665 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:19.740677 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-745cee8a-7098-4420-b254-857b7dcba665 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:19.883615 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_cell0:SELECT=4 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:15:19.925778 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-745cee8a-7098-4420-b254-857b7dcba665 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:19.937021 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-745cee8a-7098-4420-b254-857b7dcba665 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5" status: 200 len: 1723 microversion: 2.1 time: 0.219918 Aug 03 05:15:19.953907 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 155/302] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:19 2022] GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:15:19.954744 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell0:SELECT=4 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:15:20.033103 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-82d43da8-7b0c-4569-92ff-220b28362e96 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:20.034531 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-82d43da8-7b0c-4569-92ff-220b28362e96 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:20.044059 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-82d43da8-7b0c-4569-92ff-220b28362e96 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:20.047820 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-82d43da8-7b0c-4569-92ff-220b28362e96 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:20.047820 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-82d43da8-7b0c-4569-92ff-220b28362e96 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:20.047820 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-82d43da8-7b0c-4569-92ff-220b28362e96 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:20.709287 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.network.neutron [None req-b9eb7a08-3591-4cc7-83f7-def80fc0932d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] validate_networks() for [('2e69d8c5-66e7-4f9d-9779-ca17893c6637', None, None, None, None, None)] {{(pid=118331) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:15:20.899173 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-82d43da8-7b0c-4569-92ff-220b28362e96 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:20.908504 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-82d43da8-7b0c-4569-92ff-220b28362e96 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:20.910061 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-82d43da8-7b0c-4569-92ff-220b28362e96 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:20.915462 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-82d43da8-7b0c-4569-92ff-220b28362e96 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1737 microversion: 2.20 time: 0.887450 Aug 03 05:15:20.921399 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 156/303] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:15:20 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1737 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:15:20.962409 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-185c4252-04b4-4cfb-8353-ca96179b6215 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:20.963627 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-185c4252-04b4-4cfb-8353-ca96179b6215 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:20.972562 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-185c4252-04b4-4cfb-8353-ca96179b6215 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:20.977265 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-185c4252-04b4-4cfb-8353-ca96179b6215 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:20.978361 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-185c4252-04b4-4cfb-8353-ca96179b6215 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:20.983032 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-185c4252-04b4-4cfb-8353-ca96179b6215 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:21.025236 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_cell1:SELECT=100 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:15:21.329646 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-185c4252-04b4-4cfb-8353-ca96179b6215 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:21.339157 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-185c4252-04b4-4cfb-8353-ca96179b6215 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5" status: 200 len: 1723 microversion: 2.1 time: 0.381379 Aug 03 05:15:21.340670 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 157/304] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:20 2022] GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 => generated 1723 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:21.545414 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-b9eb7a08-3591-4cc7-83f7-def80fc0932d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Flavor limits 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:15:21.547486 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-b9eb7a08-3591-4cc7-83f7-def80fc0932d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Image limits 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:15:21.548598 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-b9eb7a08-3591-4cc7-83f7-def80fc0932d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Flavor pref 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:15:21.549200 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-b9eb7a08-3591-4cc7-83f7-def80fc0932d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Image pref 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:15:21.550334 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-b9eb7a08-3591-4cc7-83f7-def80fc0932d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:15:21.563456 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b9eb7a08-3591-4cc7-83f7-def80fc0932d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:21.564506 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b9eb7a08-3591-4cc7-83f7-def80fc0932d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:21.565755 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b9eb7a08-3591-4cc7-83f7-def80fc0932d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:21.566382 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b9eb7a08-3591-4cc7-83f7-def80fc0932d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:21.623835 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-b9eb7a08-3591-4cc7-83f7-def80fc0932d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Getting quotas for project 829c8e80e96d40d682a17185eb4da336. Resources: {'instances', 'ram', 'cores'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:15:21.634075 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-b9eb7a08-3591-4cc7-83f7-def80fc0932d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Getting quotas for user bb0fe4cb98e0447cad3e126da1a8de9c and project 829c8e80e96d40d682a17185eb4da336. Resources: {'instances', 'ram', 'cores'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:15:21.664829 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-b9eb7a08-3591-4cc7-83f7-def80fc0932d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Going to run 1 instances... {{(pid=118331) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:15:21.667699 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-b9eb7a08-3591-4cc7-83f7-def80fc0932d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37d7ad4a-d925-48e6-84af-ec878f19050e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:15:21.845619 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-b9eb7a08-3591-4cc7-83f7-def80fc0932d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 5.159015 Aug 03 05:15:21.853751 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 148/305] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Aug 3 05:15:16 2022] POST /compute/v2.1/servers => generated 408 bytes in 5163 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 05:15:21.864117 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-4eda1d30-117e-4755-a1b1-1a9a6c049540 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:21.864737 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-4eda1d30-117e-4755-a1b1-1a9a6c049540 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:21.946367 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-595a798e-b781-4906-9edb-cf05ba2401f1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:21.948709 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-595a798e-b781-4906-9edb-cf05ba2401f1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:21.965853 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-595a798e-b781-4906-9edb-cf05ba2401f1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:21.976711 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-595a798e-b781-4906-9edb-cf05ba2401f1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:21.976711 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-595a798e-b781-4906-9edb-cf05ba2401f1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:21.976711 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-595a798e-b781-4906-9edb-cf05ba2401f1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:21.991279 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-4eda1d30-117e-4755-a1b1-1a9a6c049540 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:22.001548 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-4eda1d30-117e-4755-a1b1-1a9a6c049540 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7" status: 200 len: 1244 microversion: 2.1 time: 0.145325 Aug 03 05:15:22.003215 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 158/306] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:21 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7 => generated 1244 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:22.250154 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-595a798e-b781-4906-9edb-cf05ba2401f1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:22.266205 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-595a798e-b781-4906-9edb-cf05ba2401f1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:22.268211 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-595a798e-b781-4906-9edb-cf05ba2401f1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:22.270581 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-595a798e-b781-4906-9edb-cf05ba2401f1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1737 microversion: 2.20 time: 0.332046 Aug 03 05:15:22.288175 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 149/307] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:15:21 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1737 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:15:22.364734 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-27e32d5c-aa25-420a-92fe-fc6b3371ea54 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:22.365353 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-27e32d5c-aa25-420a-92fe-fc6b3371ea54 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:22.376321 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-27e32d5c-aa25-420a-92fe-fc6b3371ea54 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:22.377191 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-27e32d5c-aa25-420a-92fe-fc6b3371ea54 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:22.378242 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-27e32d5c-aa25-420a-92fe-fc6b3371ea54 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:22.381382 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-27e32d5c-aa25-420a-92fe-fc6b3371ea54 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:22.656801 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-27e32d5c-aa25-420a-92fe-fc6b3371ea54 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:22.675373 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-27e32d5c-aa25-420a-92fe-fc6b3371ea54 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5" status: 200 len: 1723 microversion: 2.1 time: 0.315612 Aug 03 05:15:22.682212 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 159/308] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:22 2022] GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 => generated 1723 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:23.036632 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-4e2f8001-38e3-4808-aa87-f692126fa4e8 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:23.037610 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-4e2f8001-38e3-4808-aa87-f692126fa4e8 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:23.062552 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4e2f8001-38e3-4808-aa87-f692126fa4e8 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:23.063347 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4e2f8001-38e3-4808-aa87-f692126fa4e8 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:23.067134 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4e2f8001-38e3-4808-aa87-f692126fa4e8 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:23.067948 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4e2f8001-38e3-4808-aa87-f692126fa4e8 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:23.163358 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-4e2f8001-38e3-4808-aa87-f692126fa4e8 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:23.215577 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-4e2f8001-38e3-4808-aa87-f692126fa4e8 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7" status: 200 len: 1248 microversion: 2.1 time: 0.187520 Aug 03 05:15:23.219347 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 150/309] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:23 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7 => generated 1248 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:23.313524 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-d4c9a792-799b-4926-bcb6-938d925068b1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:23.313524 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-d4c9a792-799b-4926-bcb6-938d925068b1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:23.330484 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-d4c9a792-799b-4926-bcb6-938d925068b1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:23.331735 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-d4c9a792-799b-4926-bcb6-938d925068b1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:23.342485 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-d4c9a792-799b-4926-bcb6-938d925068b1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:23.343646 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-d4c9a792-799b-4926-bcb6-938d925068b1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:23.711836 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-d4c9a792-799b-4926-bcb6-938d925068b1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:23.721065 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-8c42742c-6265-4ad9-8a06-407bfe3b2b92 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:23.728324 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-8c42742c-6265-4ad9-8a06-407bfe3b2b92 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:23.729708 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-d4c9a792-799b-4926-bcb6-938d925068b1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:23.733679 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-d4c9a792-799b-4926-bcb6-938d925068b1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:23.734923 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-d4c9a792-799b-4926-bcb6-938d925068b1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1737 microversion: 2.20 time: 0.437055 Aug 03 05:15:23.741313 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 160/310] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:15:23 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1737 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:15:23.746240 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8c42742c-6265-4ad9-8a06-407bfe3b2b92 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:23.750278 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8c42742c-6265-4ad9-8a06-407bfe3b2b92 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:23.751679 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8c42742c-6265-4ad9-8a06-407bfe3b2b92 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:23.753009 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8c42742c-6265-4ad9-8a06-407bfe3b2b92 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:24.089835 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-8c42742c-6265-4ad9-8a06-407bfe3b2b92 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:24.109047 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-8c42742c-6265-4ad9-8a06-407bfe3b2b92 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5" status: 200 len: 1723 microversion: 2.1 time: 0.405254 Aug 03 05:15:24.110295 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 151/311] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:23 2022] GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 => generated 1723 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:24.245327 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-0729bb03-2332-4748-8cb7-4b74d70ecb2c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:24.246208 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-0729bb03-2332-4748-8cb7-4b74d70ecb2c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:24.253947 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-0729bb03-2332-4748-8cb7-4b74d70ecb2c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:24.254661 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-0729bb03-2332-4748-8cb7-4b74d70ecb2c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:24.255868 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-0729bb03-2332-4748-8cb7-4b74d70ecb2c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:24.256511 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-0729bb03-2332-4748-8cb7-4b74d70ecb2c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:24.392550 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-0729bb03-2332-4748-8cb7-4b74d70ecb2c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:24.406096 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-0729bb03-2332-4748-8cb7-4b74d70ecb2c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7" status: 200 len: 1240 microversion: 2.1 time: 0.169408 Aug 03 05:15:24.406678 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 161/312] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:24 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7 => generated 1240 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:24.778223 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-133a24e7-385c-406e-9dd4-58d5ebbe6d69 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:24.779207 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-133a24e7-385c-406e-9dd4-58d5ebbe6d69 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:24.787034 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-133a24e7-385c-406e-9dd4-58d5ebbe6d69 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:24.787813 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-133a24e7-385c-406e-9dd4-58d5ebbe6d69 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:24.789188 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-133a24e7-385c-406e-9dd4-58d5ebbe6d69 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:24.789818 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-133a24e7-385c-406e-9dd4-58d5ebbe6d69 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:25.028269 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-133a24e7-385c-406e-9dd4-58d5ebbe6d69 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:25.037226 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-133a24e7-385c-406e-9dd4-58d5ebbe6d69 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:25.038757 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-133a24e7-385c-406e-9dd4-58d5ebbe6d69 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:25.039958 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-133a24e7-385c-406e-9dd4-58d5ebbe6d69 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1737 microversion: 2.20 time: 0.274372 Aug 03 05:15:25.053577 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 152/313] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:15:24 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1737 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:15:25.136145 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-786931f5-74f5-407c-a881-9817e6814442 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:25.138497 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-786931f5-74f5-407c-a881-9817e6814442 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:25.148344 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-786931f5-74f5-407c-a881-9817e6814442 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:25.149048 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-786931f5-74f5-407c-a881-9817e6814442 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:25.150044 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-786931f5-74f5-407c-a881-9817e6814442 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:25.150519 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-786931f5-74f5-407c-a881-9817e6814442 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:25.533247 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-c9be9424-b9ab-46fe-bd6c-9dc96915d729 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:25.533247 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-c9be9424-b9ab-46fe-bd6c-9dc96915d729 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:25.533247 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c9be9424-b9ab-46fe-bd6c-9dc96915d729 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:25.533247 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c9be9424-b9ab-46fe-bd6c-9dc96915d729 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:25.534993 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c9be9424-b9ab-46fe-bd6c-9dc96915d729 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:25.534993 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c9be9424-b9ab-46fe-bd6c-9dc96915d729 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:25.535148 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-786931f5-74f5-407c-a881-9817e6814442 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:25.535148 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-786931f5-74f5-407c-a881-9817e6814442 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5" status: 200 len: 1700 microversion: 2.1 time: 0.377679 Aug 03 05:15:25.535148 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 162/314] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:25 2022] GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 => generated 1700 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:25.545059 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-cec2db60-76f1-4d6e-a4f4-a22aaf8fa3b7 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:15:25.556753 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-cec2db60-76f1-4d6e-a4f4-a22aaf8fa3b7 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:25.557478 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-cec2db60-76f1-4d6e-a4f4-a22aaf8fa3b7 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:25.756969 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-c9be9424-b9ab-46fe-bd6c-9dc96915d729 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:25.770686 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-c9be9424-b9ab-46fe-bd6c-9dc96915d729 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7" status: 200 len: 1304 microversion: 2.1 time: 0.346236 Aug 03 05:15:25.787761 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 153/315] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:25 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7 => generated 1304 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:15:25.821321 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-cec2db60-76f1-4d6e-a4f4-a22aaf8fa3b7 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Going to try to start instance {{(pid=118332) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 03 05:15:26.063206 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-85d3ac34-d2ad-43af-8bb6-0be62c8e1bc2 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:26.064392 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-85d3ac34-d2ad-43af-8bb6-0be62c8e1bc2 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:26.092315 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-85d3ac34-d2ad-43af-8bb6-0be62c8e1bc2 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:26.092315 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-85d3ac34-d2ad-43af-8bb6-0be62c8e1bc2 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:26.092315 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-85d3ac34-d2ad-43af-8bb6-0be62c8e1bc2 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:26.092315 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-85d3ac34-d2ad-43af-8bb6-0be62c8e1bc2 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:26.310272 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-85d3ac34-d2ad-43af-8bb6-0be62c8e1bc2 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:26.317889 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-85d3ac34-d2ad-43af-8bb6-0be62c8e1bc2 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:26.324182 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-85d3ac34-d2ad-43af-8bb6-0be62c8e1bc2 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:26.325481 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-85d3ac34-d2ad-43af-8bb6-0be62c8e1bc2 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1737 microversion: 2.20 time: 0.266784 Aug 03 05:15:26.326774 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 154/316] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:15:26 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1737 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 05:15:26.420763 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-cec2db60-76f1-4d6e-a4f4-a22aaf8fa3b7 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "POST /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5/action" status: 202 len: 0 microversion: 2.1 time: 0.880152 Aug 03 05:15:26.421585 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 163/317] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Aug 3 05:15:25 2022] POST /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5/action => generated 0 bytes in 882 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 05:15:26.441166 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-fabaca3e-c7b6-40f2-898c-d8f3306ac586 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:26.445983 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-fabaca3e-c7b6-40f2-898c-d8f3306ac586 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:26.459062 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fabaca3e-c7b6-40f2-898c-d8f3306ac586 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:26.462746 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fabaca3e-c7b6-40f2-898c-d8f3306ac586 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:26.462746 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fabaca3e-c7b6-40f2-898c-d8f3306ac586 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:26.462746 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fabaca3e-c7b6-40f2-898c-d8f3306ac586 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:26.801955 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-4bbbde05-937b-4b13-874f-fe199ce7df60 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:26.802658 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-4bbbde05-937b-4b13-874f-fe199ce7df60 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:26.818050 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-4bbbde05-937b-4b13-874f-fe199ce7df60 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:26.824127 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-4bbbde05-937b-4b13-874f-fe199ce7df60 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:26.825498 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-4bbbde05-937b-4b13-874f-fe199ce7df60 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:26.830682 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-4bbbde05-937b-4b13-874f-fe199ce7df60 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:26.838018 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-fabaca3e-c7b6-40f2-898c-d8f3306ac586 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:26.858776 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-fabaca3e-c7b6-40f2-898c-d8f3306ac586 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5" status: 200 len: 1709 microversion: 2.1 time: 0.430341 Aug 03 05:15:26.875575 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 155/318] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:26 2022] GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 => generated 1709 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:27.011537 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-4bbbde05-937b-4b13-874f-fe199ce7df60 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:27.024954 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-4bbbde05-937b-4b13-874f-fe199ce7df60 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7" status: 200 len: 1302 microversion: 2.1 time: 0.223457 Aug 03 05:15:27.024954 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 164/319] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:26 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7 => generated 1302 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:27.358762 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-ff1a995e-872d-4350-a8be-77d4c4424000 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:27.363005 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-ff1a995e-872d-4350-a8be-77d4c4424000 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:27.386012 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ff1a995e-872d-4350-a8be-77d4c4424000 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:27.386771 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ff1a995e-872d-4350-a8be-77d4c4424000 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:27.388064 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ff1a995e-872d-4350-a8be-77d4c4424000 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:27.388814 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ff1a995e-872d-4350-a8be-77d4c4424000 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:27.830564 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-ff1a995e-872d-4350-a8be-77d4c4424000 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:27.860915 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-ff1a995e-872d-4350-a8be-77d4c4424000 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:27.870524 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-ff1a995e-872d-4350-a8be-77d4c4424000 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:27.881529 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-65c60093-2cc2-4133-b57b-dadc36e7272d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:27.882817 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-65c60093-2cc2-4133-b57b-dadc36e7272d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:27.883864 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-ff1a995e-872d-4350-a8be-77d4c4424000 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1737 microversion: 2.20 time: 0.533688 Aug 03 05:15:27.891975 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-65c60093-2cc2-4133-b57b-dadc36e7272d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:27.893902 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-65c60093-2cc2-4133-b57b-dadc36e7272d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:27.896435 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-65c60093-2cc2-4133-b57b-dadc36e7272d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:27.898815 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-65c60093-2cc2-4133-b57b-dadc36e7272d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:27.899468 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 156/320] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:15:27 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1737 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:15:28.041770 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-7e5c0f10-f8a2-4d4d-a807-243706c7ed96 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:28.042427 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-7e5c0f10-f8a2-4d4d-a807-243706c7ed96 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:28.050918 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7e5c0f10-f8a2-4d4d-a807-243706c7ed96 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:28.051641 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7e5c0f10-f8a2-4d4d-a807-243706c7ed96 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:28.053205 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7e5c0f10-f8a2-4d4d-a807-243706c7ed96 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:28.053974 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7e5c0f10-f8a2-4d4d-a807-243706c7ed96 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:28.282160 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-65c60093-2cc2-4133-b57b-dadc36e7272d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:28.297173 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-65c60093-2cc2-4133-b57b-dadc36e7272d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5" status: 200 len: 1709 microversion: 2.1 time: 0.417155 Aug 03 05:15:28.307027 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 165/321] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:27 2022] GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 => generated 1709 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:28.496824 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-7e5c0f10-f8a2-4d4d-a807-243706c7ed96 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:28.507191 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-7e5c0f10-f8a2-4d4d-a807-243706c7ed96 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7" status: 200 len: 1369 microversion: 2.1 time: 0.469359 Aug 03 05:15:28.507794 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 157/322] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:28 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7 => generated 1369 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:15:28.921920 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-7eadfb0c-cbab-4619-bcca-2bffb465f8d1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:28.922539 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-7eadfb0c-cbab-4619-bcca-2bffb465f8d1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:28.929268 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-7eadfb0c-cbab-4619-bcca-2bffb465f8d1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:28.929724 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-7eadfb0c-cbab-4619-bcca-2bffb465f8d1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:28.930505 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-7eadfb0c-cbab-4619-bcca-2bffb465f8d1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:28.930977 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-7eadfb0c-cbab-4619-bcca-2bffb465f8d1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:28.952293 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-11521a6b-ae30-4923-9fdf-62bad7134d67 req-5615e6bc-4cc7-464b-b43c-38a93d816ea8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54dba69b-6ed5-4aff-91cb-3a98e09680d7", "tag": "961b2cd9-c56a-4c39-8446-8f00f4de31f0"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:15:28.961782 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=4 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:15:28.977580 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-11521a6b-ae30-4923-9fdf-62bad7134d67 req-5615e6bc-4cc7-464b-b43c-38a93d816ea8 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:28.977580 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-11521a6b-ae30-4923-9fdf-62bad7134d67 req-5615e6bc-4cc7-464b-b43c-38a93d816ea8 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:28.997868 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-11521a6b-ae30-4923-9fdf-62bad7134d67 req-5615e6bc-4cc7-464b-b43c-38a93d816ea8 service nova] Creating event network-changed:961b2cd9-c56a-4c39-8446-8f00f4de31f0 for instance 54dba69b-6ed5-4aff-91cb-3a98e09680d7 on hv-cinder-85127 Aug 03 05:15:29.009250 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-11521a6b-ae30-4923-9fdf-62bad7134d67 req-5615e6bc-4cc7-464b-b43c-38a93d816ea8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060537 Aug 03 05:15:29.009943 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 158/323] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:15:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:15:29.206383 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-7eadfb0c-cbab-4619-bcca-2bffb465f8d1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:29.220875 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-7eadfb0c-cbab-4619-bcca-2bffb465f8d1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:29.235786 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-7eadfb0c-cbab-4619-bcca-2bffb465f8d1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:29.235786 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-7eadfb0c-cbab-4619-bcca-2bffb465f8d1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1737 microversion: 2.20 time: 0.313868 Aug 03 05:15:29.235786 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 166/324] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:15:28 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1737 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:15:29.328197 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-2edfeb74-d125-40d0-9a9a-48c68620177d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:29.330785 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-2edfeb74-d125-40d0-9a9a-48c68620177d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:29.358505 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2edfeb74-d125-40d0-9a9a-48c68620177d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:29.359166 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2edfeb74-d125-40d0-9a9a-48c68620177d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:29.367031 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2edfeb74-d125-40d0-9a9a-48c68620177d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:29.367785 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2edfeb74-d125-40d0-9a9a-48c68620177d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:29.529250 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-f5709de4-012e-4a21-9873-f2f1c6e77a44 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:29.529660 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-f5709de4-012e-4a21-9873-f2f1c6e77a44 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:29.541747 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f5709de4-012e-4a21-9873-f2f1c6e77a44 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:29.542210 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f5709de4-012e-4a21-9873-f2f1c6e77a44 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:29.549582 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f5709de4-012e-4a21-9873-f2f1c6e77a44 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:29.550081 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f5709de4-012e-4a21-9873-f2f1c6e77a44 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:30.014009 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-2edfeb74-d125-40d0-9a9a-48c68620177d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:30.032467 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-2edfeb74-d125-40d0-9a9a-48c68620177d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5" status: 200 len: 1713 microversion: 2.1 time: 0.716310 Aug 03 05:15:30.034688 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 159/325] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:29 2022] GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 => generated 1713 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:30.230013 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-f5709de4-012e-4a21-9873-f2f1c6e77a44 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:30.244075 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-f5709de4-012e-4a21-9873-f2f1c6e77a44 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7" status: 200 len: 1369 microversion: 2.1 time: 0.719266 Aug 03 05:15:30.262057 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-d9e43f2d-377a-47d4-9cdb-34d28c6c40e1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:30.263821 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-d9e43f2d-377a-47d4-9cdb-34d28c6c40e1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:30.265904 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 167/326] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:29 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7 => generated 1369 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:30.281963 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d9e43f2d-377a-47d4-9cdb-34d28c6c40e1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:30.284301 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d9e43f2d-377a-47d4-9cdb-34d28c6c40e1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:30.291584 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d9e43f2d-377a-47d4-9cdb-34d28c6c40e1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:30.292411 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d9e43f2d-377a-47d4-9cdb-34d28c6c40e1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:30.429015 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=100 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:15:30.733518 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-d9e43f2d-377a-47d4-9cdb-34d28c6c40e1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:30.742350 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-d9e43f2d-377a-47d4-9cdb-34d28c6c40e1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:30.743793 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-d9e43f2d-377a-47d4-9cdb-34d28c6c40e1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:30.745182 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-d9e43f2d-377a-47d4-9cdb-34d28c6c40e1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1737 microversion: 2.20 time: 0.488787 Aug 03 05:15:30.745525 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 160/327] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:15:30 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1737 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:15:31.268194 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-88dbca4f-26db-448b-884a-eeeb2372b3c8 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:31.270298 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-88dbca4f-26db-448b-884a-eeeb2372b3c8 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:31.280444 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-88dbca4f-26db-448b-884a-eeeb2372b3c8 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:31.282393 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-88dbca4f-26db-448b-884a-eeeb2372b3c8 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:31.284855 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-88dbca4f-26db-448b-884a-eeeb2372b3c8 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:31.285519 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-88dbca4f-26db-448b-884a-eeeb2372b3c8 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:31.567872 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-88dbca4f-26db-448b-884a-eeeb2372b3c8 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:31.576485 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-88dbca4f-26db-448b-884a-eeeb2372b3c8 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7" status: 200 len: 1369 microversion: 2.1 time: 0.312227 Aug 03 05:15:31.578568 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 168/328] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:31 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7 => generated 1369 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:31.772453 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-576debe2-324d-43b1-b62d-2366fda4f34f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:31.781530 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-576debe2-324d-43b1-b62d-2366fda4f34f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:31.797741 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell0:SELECT=2 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:15:31.804767 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell0:SELECT=6 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:15:31.811929 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-576debe2-324d-43b1-b62d-2366fda4f34f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:31.814214 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-576debe2-324d-43b1-b62d-2366fda4f34f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:31.817762 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-576debe2-324d-43b1-b62d-2366fda4f34f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:31.821325 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-576debe2-324d-43b1-b62d-2366fda4f34f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:32.131236 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-576debe2-324d-43b1-b62d-2366fda4f34f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:32.164120 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-576debe2-324d-43b1-b62d-2366fda4f34f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:32.172351 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-576debe2-324d-43b1-b62d-2366fda4f34f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:32.174086 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-576debe2-324d-43b1-b62d-2366fda4f34f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1737 microversion: 2.20 time: 0.405389 Aug 03 05:15:32.190868 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 161/329] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:15:31 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1737 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:15:32.599946 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-d34ac4e4-851d-41b4-bf2c-8a76301a093b tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:32.601256 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-d34ac4e4-851d-41b4-bf2c-8a76301a093b tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:32.609446 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_cell0:SELECT=2 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:15:32.616207 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-d34ac4e4-851d-41b4-bf2c-8a76301a093b tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:32.617004 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-d34ac4e4-851d-41b4-bf2c-8a76301a093b tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:32.618258 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-d34ac4e4-851d-41b4-bf2c-8a76301a093b tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:32.620798 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-d34ac4e4-851d-41b4-bf2c-8a76301a093b tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:32.888153 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-d34ac4e4-851d-41b4-bf2c-8a76301a093b tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:32.896768 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-d34ac4e4-851d-41b4-bf2c-8a76301a093b tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7" status: 200 len: 1369 microversion: 2.1 time: 0.300932 Aug 03 05:15:32.911797 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 169/330] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:32 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7 => generated 1369 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:33.202070 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-015524e1-392b-45d4-a89a-f486748b7596 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:33.202831 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-015524e1-392b-45d4-a89a-f486748b7596 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:33.218486 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-015524e1-392b-45d4-a89a-f486748b7596 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:33.219109 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-015524e1-392b-45d4-a89a-f486748b7596 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:33.227289 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-015524e1-392b-45d4-a89a-f486748b7596 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:33.227875 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-015524e1-392b-45d4-a89a-f486748b7596 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:33.450894 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-015524e1-392b-45d4-a89a-f486748b7596 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:33.462457 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-015524e1-392b-45d4-a89a-f486748b7596 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:33.464164 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-015524e1-392b-45d4-a89a-f486748b7596 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:33.465964 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-015524e1-392b-45d4-a89a-f486748b7596 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1737 microversion: 2.20 time: 0.268257 Aug 03 05:15:33.466593 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 162/331] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:15:33 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1737 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:15:33.923037 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-e2d37f32-87ae-443f-8a79-b54aa0c5c29e tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:33.924547 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-e2d37f32-87ae-443f-8a79-b54aa0c5c29e tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:33.932373 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=1 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:15:33.939313 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e2d37f32-87ae-443f-8a79-b54aa0c5c29e tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:33.940244 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e2d37f32-87ae-443f-8a79-b54aa0c5c29e tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:33.941364 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e2d37f32-87ae-443f-8a79-b54aa0c5c29e tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:33.942983 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e2d37f32-87ae-443f-8a79-b54aa0c5c29e tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:34.278510 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-e2d37f32-87ae-443f-8a79-b54aa0c5c29e tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:34.298065 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-e2d37f32-87ae-443f-8a79-b54aa0c5c29e tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7" status: 200 len: 1369 microversion: 2.1 time: 0.380192 Aug 03 05:15:34.324560 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 170/332] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:33 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7 => generated 1369 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:34.498536 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-94bd8984-0746-4572-8a51-34e515de5ebc tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:34.499174 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-94bd8984-0746-4572-8a51-34e515de5ebc tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:34.514641 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-94bd8984-0746-4572-8a51-34e515de5ebc tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:34.515285 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-94bd8984-0746-4572-8a51-34e515de5ebc tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:34.516098 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-94bd8984-0746-4572-8a51-34e515de5ebc tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:34.516568 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-94bd8984-0746-4572-8a51-34e515de5ebc tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:34.794322 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-94bd8984-0746-4572-8a51-34e515de5ebc tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:34.830056 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-94bd8984-0746-4572-8a51-34e515de5ebc tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:34.832856 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-94bd8984-0746-4572-8a51-34e515de5ebc tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:34.834344 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-94bd8984-0746-4572-8a51-34e515de5ebc tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1737 microversion: 2.20 time: 0.340041 Aug 03 05:15:34.845613 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 163/333] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:15:34 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1737 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:15:35.339537 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-116ef86b-5994-488f-b30d-70cd72eb381d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:35.340426 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-116ef86b-5994-488f-b30d-70cd72eb381d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:35.347598 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-116ef86b-5994-488f-b30d-70cd72eb381d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:35.348056 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-116ef86b-5994-488f-b30d-70cd72eb381d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:35.349050 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-116ef86b-5994-488f-b30d-70cd72eb381d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:35.349582 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-116ef86b-5994-488f-b30d-70cd72eb381d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:35.552486 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-116ef86b-5994-488f-b30d-70cd72eb381d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:35.561365 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-116ef86b-5994-488f-b30d-70cd72eb381d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7" status: 200 len: 1369 microversion: 2.1 time: 0.227402 Aug 03 05:15:35.578807 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 171/334] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:35 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7 => generated 1369 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:35.867082 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-a0340971-1502-481f-aff7-3cf84655ee99 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:35.867671 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-a0340971-1502-481f-aff7-3cf84655ee99 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:35.883994 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a0340971-1502-481f-aff7-3cf84655ee99 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:35.884449 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a0340971-1502-481f-aff7-3cf84655ee99 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:35.885224 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a0340971-1502-481f-aff7-3cf84655ee99 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:35.885660 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a0340971-1502-481f-aff7-3cf84655ee99 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:36.311395 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-a0340971-1502-481f-aff7-3cf84655ee99 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:36.321633 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-a0340971-1502-481f-aff7-3cf84655ee99 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:36.323517 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-a0340971-1502-481f-aff7-3cf84655ee99 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:36.337220 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-a0340971-1502-481f-aff7-3cf84655ee99 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1737 microversion: 2.20 time: 0.462480 Aug 03 05:15:36.337220 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 164/335] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:15:35 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1737 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 05:15:36.599993 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-833e1304-ffc2-4762-8396-900c194ffd6a tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:36.600874 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-833e1304-ffc2-4762-8396-900c194ffd6a tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:36.609489 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-833e1304-ffc2-4762-8396-900c194ffd6a tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:36.612516 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-833e1304-ffc2-4762-8396-900c194ffd6a tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:36.616788 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-833e1304-ffc2-4762-8396-900c194ffd6a tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:36.618096 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-833e1304-ffc2-4762-8396-900c194ffd6a tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:36.820152 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-833e1304-ffc2-4762-8396-900c194ffd6a tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:36.844802 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-833e1304-ffc2-4762-8396-900c194ffd6a tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7" status: 200 len: 1369 microversion: 2.1 time: 0.234540 Aug 03 05:15:36.855565 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 172/336] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:36 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7 => generated 1369 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:37.355570 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-dbfeee01-9337-4531-86bc-89b7f2f1371f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:37.357588 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-dbfeee01-9337-4531-86bc-89b7f2f1371f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:37.366392 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-dbfeee01-9337-4531-86bc-89b7f2f1371f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:37.367471 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-dbfeee01-9337-4531-86bc-89b7f2f1371f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:37.368842 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-dbfeee01-9337-4531-86bc-89b7f2f1371f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:37.369493 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-dbfeee01-9337-4531-86bc-89b7f2f1371f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:37.622620 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-dbfeee01-9337-4531-86bc-89b7f2f1371f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:37.636953 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-dbfeee01-9337-4531-86bc-89b7f2f1371f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:37.640929 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-dbfeee01-9337-4531-86bc-89b7f2f1371f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:37.642304 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-dbfeee01-9337-4531-86bc-89b7f2f1371f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1737 microversion: 2.20 time: 0.292696 Aug 03 05:15:37.643357 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 165/337] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:15:37 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1737 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:15:37.876388 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-169b380c-6d93-4e50-b5c6-6c1797677fb8 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:37.878468 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-169b380c-6d93-4e50-b5c6-6c1797677fb8 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:37.885812 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-169b380c-6d93-4e50-b5c6-6c1797677fb8 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:37.891657 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-169b380c-6d93-4e50-b5c6-6c1797677fb8 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:37.892779 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-169b380c-6d93-4e50-b5c6-6c1797677fb8 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:37.893395 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-169b380c-6d93-4e50-b5c6-6c1797677fb8 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:38.181444 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-169b380c-6d93-4e50-b5c6-6c1797677fb8 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:38.190485 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-169b380c-6d93-4e50-b5c6-6c1797677fb8 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7" status: 200 len: 1369 microversion: 2.1 time: 0.319106 Aug 03 05:15:38.191959 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 173/338] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:37 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7 => generated 1369 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:38.676044 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-25636db6-f9d2-4e57-86ee-635443095a3b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:38.684362 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-25636db6-f9d2-4e57-86ee-635443095a3b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:38.687438 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-25636db6-f9d2-4e57-86ee-635443095a3b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:38.688177 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-25636db6-f9d2-4e57-86ee-635443095a3b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:38.689188 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-25636db6-f9d2-4e57-86ee-635443095a3b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:38.689898 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-25636db6-f9d2-4e57-86ee-635443095a3b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:38.953768 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-25636db6-f9d2-4e57-86ee-635443095a3b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:38.969932 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-25636db6-f9d2-4e57-86ee-635443095a3b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:38.972916 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-25636db6-f9d2-4e57-86ee-635443095a3b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:38.974126 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-25636db6-f9d2-4e57-86ee-635443095a3b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1737 microversion: 2.20 time: 0.304250 Aug 03 05:15:38.975279 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 166/339] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:15:38 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1737 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:15:39.216449 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-f2118ef3-a33c-416c-86dd-615d3ed8e903 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:39.218143 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-f2118ef3-a33c-416c-86dd-615d3ed8e903 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:39.226247 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f2118ef3-a33c-416c-86dd-615d3ed8e903 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:39.226766 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f2118ef3-a33c-416c-86dd-615d3ed8e903 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:39.227928 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f2118ef3-a33c-416c-86dd-615d3ed8e903 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:39.228550 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f2118ef3-a33c-416c-86dd-615d3ed8e903 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:39.244635 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:15:39.808480 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-f2118ef3-a33c-416c-86dd-615d3ed8e903 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:39.821564 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-f2118ef3-a33c-416c-86dd-615d3ed8e903 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7" status: 200 len: 1369 microversion: 2.1 time: 0.611966 Aug 03 05:15:39.823774 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 174/340] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:39 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7 => generated 1369 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:40.001038 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-a9ed70bd-d8cb-41fa-ba31-4b8defc6af56 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:40.001961 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-a9ed70bd-d8cb-41fa-ba31-4b8defc6af56 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:40.009806 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a9ed70bd-d8cb-41fa-ba31-4b8defc6af56 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:40.010269 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a9ed70bd-d8cb-41fa-ba31-4b8defc6af56 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:40.011081 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a9ed70bd-d8cb-41fa-ba31-4b8defc6af56 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:40.011527 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a9ed70bd-d8cb-41fa-ba31-4b8defc6af56 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:40.297641 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-a9ed70bd-d8cb-41fa-ba31-4b8defc6af56 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:40.306878 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-a9ed70bd-d8cb-41fa-ba31-4b8defc6af56 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:40.308797 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-a9ed70bd-d8cb-41fa-ba31-4b8defc6af56 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:40.309964 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-a9ed70bd-d8cb-41fa-ba31-4b8defc6af56 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1737 microversion: 2.20 time: 0.312838 Aug 03 05:15:40.310577 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 167/341] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:15:39 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1737 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:15:40.819748 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-e2889075-90d2-4536-bae6-1a9f16e0fe74 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Action: 'create', calling method: .version_select at 0x7f76020f7af0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-412529992", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDjQ24jQlpjVTLfqwZshouLUA87LSn97K2epxl45MyoazMjGm7Ua3w3j8MiOHgdcADLxXu6V0WNQau9raL5wr9MuprrrlHrnllS9KU66MbQTZ5xCsZfvF2ZTDvRLRE4xQ=="}} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:15:40.848301 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-422d54aa-2c6f-49df-a8e5-f544496c9be8 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:40.849055 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-422d54aa-2c6f-49df-a8e5-f544496c9be8 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:40.856773 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-422d54aa-2c6f-49df-a8e5-f544496c9be8 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:40.859199 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.quota [None req-e2889075-90d2-4536-bae6-1a9f16e0fe74 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Getting quotas for project 7d7bf6baa2224b0d910133c5542608e1. Resources: {'key_pairs'} {{(pid=118332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:15:40.860130 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-422d54aa-2c6f-49df-a8e5-f544496c9be8 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:40.862726 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-422d54aa-2c6f-49df-a8e5-f544496c9be8 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:40.867824 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-422d54aa-2c6f-49df-a8e5-f544496c9be8 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:40.873487 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.quota [None req-e2889075-90d2-4536-bae6-1a9f16e0fe74 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Getting quotas for user 79539af2999d48baa11734ced32dccb2 and project 7d7bf6baa2224b0d910133c5542608e1. Resources: {'key_pairs'} {{(pid=118332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:15:40.961226 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-e2889075-90d2-4536-bae6-1a9f16e0fe74 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.146849 Aug 03 05:15:40.962634 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 175/342] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Aug 3 05:15:40 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:15:41.087426 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-422d54aa-2c6f-49df-a8e5-f544496c9be8 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:41.101770 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-3e87d83b-0d65-44a2-967d-729fcca1fbcf tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1874802087", "imageRef": "c94293fc-32d8-4a40-840f-57cf64965b71", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-412529992", "networks": [{"uuid": "2270a235-f065-4e37-a7ab-2cf88c3883db"}]}} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:15:41.116316 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-422d54aa-2c6f-49df-a8e5-f544496c9be8 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7" status: 200 len: 1369 microversion: 2.1 time: 0.274197 Aug 03 05:15:41.118952 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 168/343] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:40 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7 => generated 1369 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:41.337192 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-980b2a2c-34a2-40e2-8e19-d200cb64589d tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:41.338280 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-980b2a2c-34a2-40e2-8e19-d200cb64589d tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:41.348342 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-980b2a2c-34a2-40e2-8e19-d200cb64589d tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:41.349538 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-980b2a2c-34a2-40e2-8e19-d200cb64589d tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:41.357468 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-980b2a2c-34a2-40e2-8e19-d200cb64589d tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:41.358533 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-980b2a2c-34a2-40e2-8e19-d200cb64589d tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:41.542554 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-980b2a2c-34a2-40e2-8e19-d200cb64589d tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:41.565425 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-980b2a2c-34a2-40e2-8e19-d200cb64589d tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:41.567845 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-980b2a2c-34a2-40e2-8e19-d200cb64589d tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:41.570081 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-980b2a2c-34a2-40e2-8e19-d200cb64589d tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1737 microversion: 2.20 time: 0.239576 Aug 03 05:15:41.571183 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 169/344] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:15:41 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1737 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 05:15:42.146216 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-18f709e0-ea9f-4c1c-b902-01d405d2a73f tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:42.146892 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-18f709e0-ea9f-4c1c-b902-01d405d2a73f tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:42.153960 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-18f709e0-ea9f-4c1c-b902-01d405d2a73f tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:42.154524 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-18f709e0-ea9f-4c1c-b902-01d405d2a73f tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:42.155379 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-18f709e0-ea9f-4c1c-b902-01d405d2a73f tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:42.156025 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-18f709e0-ea9f-4c1c-b902-01d405d2a73f tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:42.314633 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-18f709e0-ea9f-4c1c-b902-01d405d2a73f tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:42.326761 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-18f709e0-ea9f-4c1c-b902-01d405d2a73f tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7" status: 200 len: 1369 microversion: 2.1 time: 0.185584 Aug 03 05:15:42.327406 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 170/345] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:42 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7 => generated 1369 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:15:42.602907 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-9ab3c531-7839-497e-aaf4-d9d2f1046917 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:42.603689 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-9ab3c531-7839-497e-aaf4-d9d2f1046917 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:42.613580 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9ab3c531-7839-497e-aaf4-d9d2f1046917 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:42.614392 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9ab3c531-7839-497e-aaf4-d9d2f1046917 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:42.616252 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9ab3c531-7839-497e-aaf4-d9d2f1046917 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:42.617090 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9ab3c531-7839-497e-aaf4-d9d2f1046917 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:42.904784 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-9ab3c531-7839-497e-aaf4-d9d2f1046917 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:42.914186 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-9ab3c531-7839-497e-aaf4-d9d2f1046917 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:42.916191 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-9ab3c531-7839-497e-aaf4-d9d2f1046917 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:42.917583 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-9ab3c531-7839-497e-aaf4-d9d2f1046917 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1719 microversion: 2.20 time: 0.319767 Aug 03 05:15:42.919061 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 171/346] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:15:42 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1719 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:15:43.347503 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-878c3a10-afee-4054-99c0-8fe6a85edc82 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:43.348674 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-878c3a10-afee-4054-99c0-8fe6a85edc82 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:43.358269 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-878c3a10-afee-4054-99c0-8fe6a85edc82 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:43.358834 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-878c3a10-afee-4054-99c0-8fe6a85edc82 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:43.359640 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-878c3a10-afee-4054-99c0-8fe6a85edc82 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:43.360083 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-878c3a10-afee-4054-99c0-8fe6a85edc82 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:43.507132 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-878c3a10-afee-4054-99c0-8fe6a85edc82 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:43.516051 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-878c3a10-afee-4054-99c0-8fe6a85edc82 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7" status: 200 len: 1369 microversion: 2.1 time: 0.172540 Aug 03 05:15:43.516759 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 172/347] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:43 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7 => generated 1369 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:15:43.943258 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-99bdc105-b64f-450e-80ee-f734803e883a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:43.944436 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-99bdc105-b64f-450e-80ee-f734803e883a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:43.953054 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-99bdc105-b64f-450e-80ee-f734803e883a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:43.953848 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-99bdc105-b64f-450e-80ee-f734803e883a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:43.955076 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-99bdc105-b64f-450e-80ee-f734803e883a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:43.955921 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-99bdc105-b64f-450e-80ee-f734803e883a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:44.122067 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-99bdc105-b64f-450e-80ee-f734803e883a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:44.132812 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-99bdc105-b64f-450e-80ee-f734803e883a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:44.134406 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-99bdc105-b64f-450e-80ee-f734803e883a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:44.135621 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-99bdc105-b64f-450e-80ee-f734803e883a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1719 microversion: 2.20 time: 0.197306 Aug 03 05:15:44.136204 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 173/348] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:15:43 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1719 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:15:44.538616 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-5b94519a-f52f-4b7c-983f-80bdb8fc6fa3 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:44.540516 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-5b94519a-f52f-4b7c-983f-80bdb8fc6fa3 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:44.548997 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5b94519a-f52f-4b7c-983f-80bdb8fc6fa3 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:44.555484 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5b94519a-f52f-4b7c-983f-80bdb8fc6fa3 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:44.555484 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5b94519a-f52f-4b7c-983f-80bdb8fc6fa3 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:44.555484 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5b94519a-f52f-4b7c-983f-80bdb8fc6fa3 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:44.814968 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-5b94519a-f52f-4b7c-983f-80bdb8fc6fa3 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:44.823626 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-5b94519a-f52f-4b7c-983f-80bdb8fc6fa3 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7" status: 200 len: 1369 microversion: 2.1 time: 0.289510 Aug 03 05:15:44.824361 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 174/349] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:44 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7 => generated 1369 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:45.165925 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-d0103a22-197d-4436-b849-90fa261f091f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:45.166650 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-d0103a22-197d-4436-b849-90fa261f091f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:45.174530 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d0103a22-197d-4436-b849-90fa261f091f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:45.175126 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d0103a22-197d-4436-b849-90fa261f091f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:45.176050 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d0103a22-197d-4436-b849-90fa261f091f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:45.176584 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d0103a22-197d-4436-b849-90fa261f091f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:45.349864 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-d0103a22-197d-4436-b849-90fa261f091f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:45.364779 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-d0103a22-197d-4436-b849-90fa261f091f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:45.366575 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-d0103a22-197d-4436-b849-90fa261f091f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:45.367688 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-d0103a22-197d-4436-b849-90fa261f091f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1719 microversion: 2.20 time: 0.206840 Aug 03 05:15:45.384553 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 175/350] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:15:45 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1719 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 05:15:45.845853 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-e1dc3a41-1a17-4aec-85d4-7bf83e5c5df6 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:45.854235 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-e1dc3a41-1a17-4aec-85d4-7bf83e5c5df6 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:45.866226 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e1dc3a41-1a17-4aec-85d4-7bf83e5c5df6 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:45.867087 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e1dc3a41-1a17-4aec-85d4-7bf83e5c5df6 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:45.868138 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e1dc3a41-1a17-4aec-85d4-7bf83e5c5df6 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:45.869997 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e1dc3a41-1a17-4aec-85d4-7bf83e5c5df6 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:46.073356 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-e1dc3a41-1a17-4aec-85d4-7bf83e5c5df6 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:46.083924 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-e1dc3a41-1a17-4aec-85d4-7bf83e5c5df6 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7" status: 200 len: 1369 microversion: 2.1 time: 0.241251 Aug 03 05:15:46.085022 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 176/351] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:45 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7 => generated 1369 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:46.094940 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-6f0c19fa-263f-4548-ae2d-c44709e1b089 req-661345fa-00e5-4c7e-a3cb-3f1ec71edc94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54dba69b-6ed5-4aff-91cb-3a98e09680d7", "name": "network-vif-plugged", "status": "completed", "tag": "961b2cd9-c56a-4c39-8446-8f00f4de31f0"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:15:46.108103 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-6f0c19fa-263f-4548-ae2d-c44709e1b089 req-661345fa-00e5-4c7e-a3cb-3f1ec71edc94 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:46.108670 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-6f0c19fa-263f-4548-ae2d-c44709e1b089 req-661345fa-00e5-4c7e-a3cb-3f1ec71edc94 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:46.116552 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=100 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:15:46.142702 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-6f0c19fa-263f-4548-ae2d-c44709e1b089 req-661345fa-00e5-4c7e-a3cb-3f1ec71edc94 service nova] Creating event network-vif-plugged:961b2cd9-c56a-4c39-8446-8f00f4de31f0 for instance 54dba69b-6ed5-4aff-91cb-3a98e09680d7 on hv-cinder-85127 Aug 03 05:15:46.149639 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-6f0c19fa-263f-4548-ae2d-c44709e1b089 req-661345fa-00e5-4c7e-a3cb-3f1ec71edc94 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063049 Aug 03 05:15:46.150740 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 177/352] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:15:46.393701 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-80e324ac-8034-444c-957c-b995bd4e203e tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:46.394313 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-80e324ac-8034-444c-957c-b995bd4e203e tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:46.406367 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-80e324ac-8034-444c-957c-b995bd4e203e tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:46.406794 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-80e324ac-8034-444c-957c-b995bd4e203e tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:46.407651 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-80e324ac-8034-444c-957c-b995bd4e203e tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:46.408052 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-80e324ac-8034-444c-957c-b995bd4e203e tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:46.668021 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-80e324ac-8034-444c-957c-b995bd4e203e tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:46.677767 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-80e324ac-8034-444c-957c-b995bd4e203e tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:46.679389 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-80e324ac-8034-444c-957c-b995bd4e203e tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:46.688761 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-80e324ac-8034-444c-957c-b995bd4e203e tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1662 microversion: 2.20 time: 0.292175 Aug 03 05:15:46.688761 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 178/353] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:15:46 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1662 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 05:15:46.703867 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-78f7d1fc-bdb2-4a66-9316-a95ef8939e6b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a8522739-bacc-493e-9812-f074d1bd34f3"}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:15:46.706244 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-78f7d1fc-bdb2-4a66-9316-a95ef8939e6b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:46.714333 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-78f7d1fc-bdb2-4a66-9316-a95ef8939e6b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:46.716804 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-78f7d1fc-bdb2-4a66-9316-a95ef8939e6b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:46.719253 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-78f7d1fc-bdb2-4a66-9316-a95ef8939e6b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:46.719991 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-78f7d1fc-bdb2-4a66-9316-a95ef8939e6b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:47.851092 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-78f7d1fc-bdb2-4a66-9316-a95ef8939e6b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "POST /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.151756 Aug 03 05:15:47.851909 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 179/354] 10.222.0.40 () {62 vars in 1364 bytes} [Wed Aug 3 05:15:46 2022] POST /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1/os-volume_attachments => generated 188 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 05:15:47.858064 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-0aaece66-a022-4b61-b63d-bee1e7b3073c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:47.860437 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-0aaece66-a022-4b61-b63d-bee1e7b3073c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:47.867078 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0aaece66-a022-4b61-b63d-bee1e7b3073c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:47.867664 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0aaece66-a022-4b61-b63d-bee1e7b3073c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:47.868529 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0aaece66-a022-4b61-b63d-bee1e7b3073c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:47.868984 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0aaece66-a022-4b61-b63d-bee1e7b3073c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:48.043670 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-0aaece66-a022-4b61-b63d-bee1e7b3073c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:48.059850 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-0aaece66-a022-4b61-b63d-bee1e7b3073c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7" status: 200 len: 1369 microversion: 2.1 time: 0.206753 Aug 03 05:15:48.061067 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 180/355] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:47 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7 => generated 1369 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:48.066075 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-43b0258c-6702-47b1-a701-fad905de8900 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:15:48.066672 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-43b0258c-6702-47b1-a701-fad905de8900 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:48.073254 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-43b0258c-6702-47b1-a701-fad905de8900 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:48.074018 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-43b0258c-6702-47b1-a701-fad905de8900 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:48.074806 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-43b0258c-6702-47b1-a701-fad905de8900 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:48.075282 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-43b0258c-6702-47b1-a701-fad905de8900 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:48.129527 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-43b0258c-6702-47b1-a701-fad905de8900 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118331) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 03 05:15:48.466130 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-43b0258c-6702-47b1-a701-fad905de8900 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "POST /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1/action" status: 202 len: 0 microversion: 2.20 time: 0.397401 Aug 03 05:15:48.467395 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 181/356] 10.222.0.40 () {62 vars in 1319 bytes} [Wed Aug 3 05:15:48 2022] POST /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1/action => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:15:48.478771 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-532c9ab6-f447-4208-be19-cb035ab305f4 req-2f342669-2cff-452a-9fe3-4290b5519972 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69089938-1d69-415c-8344-e6b9f78f16d1", "name": "network-vif-unplugged", "status": "completed", "tag": "602350b3-725c-4735-99e8-acb9b77192fa"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:15:48.490508 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-532c9ab6-f447-4208-be19-cb035ab305f4 req-2f342669-2cff-452a-9fe3-4290b5519972 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:48.491179 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-532c9ab6-f447-4208-be19-cb035ab305f4 req-2f342669-2cff-452a-9fe3-4290b5519972 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:48.504429 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.compute.server_external_events [req-532c9ab6-f447-4208-be19-cb035ab305f4 req-2f342669-2cff-452a-9fe3-4290b5519972 service nova] Unable to find a host for instance 69089938-1d69-415c-8344-e6b9f78f16d1. Dropping event network-vif-unplugged {{(pid=118331) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 03 05:15:48.506533 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-532c9ab6-f447-4208-be19-cb035ab305f4 req-2f342669-2cff-452a-9fe3-4290b5519972 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.035171 Aug 03 05:15:48.506533 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 182/357] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 03 05:15:48.512232 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-36533be7-06fd-4d3d-a747-e6325bbd6ebc tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:48.513007 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-36533be7-06fd-4d3d-a747-e6325bbd6ebc tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:48.519732 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-36533be7-06fd-4d3d-a747-e6325bbd6ebc tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:48.520183 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-36533be7-06fd-4d3d-a747-e6325bbd6ebc tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:48.521180 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-36533be7-06fd-4d3d-a747-e6325bbd6ebc tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:48.521626 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-36533be7-06fd-4d3d-a747-e6325bbd6ebc tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:48.706862 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-36533be7-06fd-4d3d-a747-e6325bbd6ebc tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:48.718501 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-36533be7-06fd-4d3d-a747-e6325bbd6ebc tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:48.720536 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-36533be7-06fd-4d3d-a747-e6325bbd6ebc tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:48.722032 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-36533be7-06fd-4d3d-a747-e6325bbd6ebc tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1748 microversion: 2.20 time: 0.214431 Aug 03 05:15:48.723169 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 183/358] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:15:48 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1748 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:15:49.083916 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-0a0bf0a8-1a73-445a-badd-9bc2d3203416 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:49.084662 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-0a0bf0a8-1a73-445a-badd-9bc2d3203416 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:49.095443 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0a0bf0a8-1a73-445a-badd-9bc2d3203416 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:49.095900 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0a0bf0a8-1a73-445a-badd-9bc2d3203416 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:49.096677 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0a0bf0a8-1a73-445a-badd-9bc2d3203416 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:49.097118 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0a0bf0a8-1a73-445a-badd-9bc2d3203416 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:49.279384 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-0a0bf0a8-1a73-445a-badd-9bc2d3203416 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:49.290019 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-0a0bf0a8-1a73-445a-badd-9bc2d3203416 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7" status: 200 len: 1563 microversion: 2.1 time: 0.209151 Aug 03 05:15:49.303760 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 184/359] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:49 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7 => generated 1563 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:15:49.314170 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-a84b7044-304d-4b0d-8e01-3ca5853b40a8 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:49.314676 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-a84b7044-304d-4b0d-8e01-3ca5853b40a8 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:49.328792 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a84b7044-304d-4b0d-8e01-3ca5853b40a8 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:49.329368 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a84b7044-304d-4b0d-8e01-3ca5853b40a8 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:49.330242 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a84b7044-304d-4b0d-8e01-3ca5853b40a8 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:49.330782 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a84b7044-304d-4b0d-8e01-3ca5853b40a8 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:49.484515 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-a84b7044-304d-4b0d-8e01-3ca5853b40a8 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.174065 Aug 03 05:15:49.485652 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 185/360] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Aug 3 05:15:49 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7/os-interface => generated 285 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:15:49.751470 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-43675116-7fb4-46fa-847e-d6689e62a3fe tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:49.752541 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-43675116-7fb4-46fa-847e-d6689e62a3fe tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:49.760387 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-43675116-7fb4-46fa-847e-d6689e62a3fe tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:49.761672 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-43675116-7fb4-46fa-847e-d6689e62a3fe tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:49.762520 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-43675116-7fb4-46fa-847e-d6689e62a3fe tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:49.763501 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-43675116-7fb4-46fa-847e-d6689e62a3fe tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:49.814412 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_cell1:SELECT=4 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:15:49.931261 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-43675116-7fb4-46fa-847e-d6689e62a3fe tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:49.950723 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-43675116-7fb4-46fa-847e-d6689e62a3fe tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:49.967975 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-43675116-7fb4-46fa-847e-d6689e62a3fe tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:49.970368 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-43675116-7fb4-46fa-847e-d6689e62a3fe tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1748 microversion: 2.20 time: 0.223588 Aug 03 05:15:49.983088 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 186/361] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:15:49 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1748 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 05:15:50.892629 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_cell0:SELECT=4 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:15:50.968647 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-437a02a5-b5ff-4671-9d85-82f75e12ae60 req-1f1d00a9-c985-4d51-926c-43fcbb6b85bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54dba69b-6ed5-4aff-91cb-3a98e09680d7", "tag": "961b2cd9-c56a-4c39-8446-8f00f4de31f0"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:15:50.978743 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-437a02a5-b5ff-4671-9d85-82f75e12ae60 req-1f1d00a9-c985-4d51-926c-43fcbb6b85bd service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:50.979305 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-437a02a5-b5ff-4671-9d85-82f75e12ae60 req-1f1d00a9-c985-4d51-926c-43fcbb6b85bd service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:50.990760 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-437a02a5-b5ff-4671-9d85-82f75e12ae60 req-1f1d00a9-c985-4d51-926c-43fcbb6b85bd service nova] Creating event network-changed:961b2cd9-c56a-4c39-8446-8f00f4de31f0 for instance 54dba69b-6ed5-4aff-91cb-3a98e09680d7 on hv-cinder-85127 Aug 03 05:15:50.996187 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-437a02a5-b5ff-4671-9d85-82f75e12ae60 req-1f1d00a9-c985-4d51-926c-43fcbb6b85bd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032296 Aug 03 05:15:50.997003 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 187/362] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:15:51.001983 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-4dda3fce-7e3b-4b30-9864-2bb8baf6b4b6 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:51.002673 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-4dda3fce-7e3b-4b30-9864-2bb8baf6b4b6 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:51.009407 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4dda3fce-7e3b-4b30-9864-2bb8baf6b4b6 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:51.010033 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4dda3fce-7e3b-4b30-9864-2bb8baf6b4b6 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:51.012195 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4dda3fce-7e3b-4b30-9864-2bb8baf6b4b6 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:51.012755 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4dda3fce-7e3b-4b30-9864-2bb8baf6b4b6 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:51.126249 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=1 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:15:51.262300 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-4dda3fce-7e3b-4b30-9864-2bb8baf6b4b6 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:51.275727 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-4dda3fce-7e3b-4b30-9864-2bb8baf6b4b6 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:51.279192 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-4dda3fce-7e3b-4b30-9864-2bb8baf6b4b6 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:51.280774 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-4dda3fce-7e3b-4b30-9864-2bb8baf6b4b6 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1748 microversion: 2.20 time: 0.282698 Aug 03 05:15:51.281501 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 188/363] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:15:50 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1748 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:15:51.693595 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.network.neutron [None req-3e87d83b-0d65-44a2-967d-729fcca1fbcf tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] validate_networks() for [('2270a235-f065-4e37-a7ab-2cf88c3883db', None, None, None, None, None)] {{(pid=118332) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:15:52.307443 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-50c4e47b-b703-441f-82ac-97b6b8c3766f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:52.309002 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-50c4e47b-b703-441f-82ac-97b6b8c3766f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:52.320457 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-50c4e47b-b703-441f-82ac-97b6b8c3766f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:52.321008 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-50c4e47b-b703-441f-82ac-97b6b8c3766f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:52.321960 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-50c4e47b-b703-441f-82ac-97b6b8c3766f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:52.322471 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-50c4e47b-b703-441f-82ac-97b6b8c3766f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:52.414457 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.virt.hardware [None req-3e87d83b-0d65-44a2-967d-729fcca1fbcf tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Flavor limits 0:0:0 {{(pid=118332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:15:52.415095 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.virt.hardware [None req-3e87d83b-0d65-44a2-967d-729fcca1fbcf tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Image limits 0:0:0 {{(pid=118332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:15:52.415429 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.virt.hardware [None req-3e87d83b-0d65-44a2-967d-729fcca1fbcf tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Flavor pref 0:0:0 {{(pid=118332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:15:52.416149 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.virt.hardware [None req-3e87d83b-0d65-44a2-967d-729fcca1fbcf tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Image pref 0:0:0 {{(pid=118332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:15:52.416714 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.virt.hardware [None req-3e87d83b-0d65-44a2-967d-729fcca1fbcf tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:15:52.428177 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3e87d83b-0d65-44a2-967d-729fcca1fbcf tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:52.429025 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3e87d83b-0d65-44a2-967d-729fcca1fbcf tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:52.430909 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3e87d83b-0d65-44a2-967d-729fcca1fbcf tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:52.431826 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3e87d83b-0d65-44a2-967d-729fcca1fbcf tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:52.452033 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.quota [None req-3e87d83b-0d65-44a2-967d-729fcca1fbcf tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Getting quotas for project 7d7bf6baa2224b0d910133c5542608e1. Resources: {'instances', 'ram', 'cores'} {{(pid=118332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:15:52.456893 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.quota [None req-3e87d83b-0d65-44a2-967d-729fcca1fbcf tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Getting quotas for user 79539af2999d48baa11734ced32dccb2 and project 7d7bf6baa2224b0d910133c5542608e1. Resources: {'instances', 'ram', 'cores'} {{(pid=118332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:15:52.470816 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-3e87d83b-0d65-44a2-967d-729fcca1fbcf tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Going to run 1 instances... {{(pid=118332) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:15:52.473317 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-3e87d83b-0d65-44a2-967d-729fcca1fbcf tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] [instance: 363118dd-a0c3-444f-99cb-f0578407e0d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c94293fc-32d8-4a40-840f-57cf64965b71',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:15:52.588970 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-50c4e47b-b703-441f-82ac-97b6b8c3766f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:52.601576 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-50c4e47b-b703-441f-82ac-97b6b8c3766f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:52.621518 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-50c4e47b-b703-441f-82ac-97b6b8c3766f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:52.623946 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-50c4e47b-b703-441f-82ac-97b6b8c3766f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1748 microversion: 2.20 time: 0.320966 Aug 03 05:15:52.641864 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 189/364] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:15:52 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1748 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:15:52.664235 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-3e87d83b-0d65-44a2-967d-729fcca1fbcf tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 11.567372 Aug 03 05:15:52.675361 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 176/365] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Aug 3 05:15:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 11580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 05:15:52.685460 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-3afbc474-11d1-4dc0-ac43-03f9cfd2463c tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:52.686125 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-3afbc474-11d1-4dc0-ac43-03f9cfd2463c tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] [instance: 363118dd-a0c3-444f-99cb-f0578407e0d2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:52.790002 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-3afbc474-11d1-4dc0-ac43-03f9cfd2463c tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79539af2999d48baa11734ced32dccb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d7bf6baa2224b0d910133c5542608e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:52.808250 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-3afbc474-11d1-4dc0-ac43-03f9cfd2463c tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2" status: 200 len: 1258 microversion: 2.1 time: 0.126930 Aug 03 05:15:52.810219 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 190/366] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:52 2022] GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2 => generated 1258 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:53.649365 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-700b0401-f280-4806-afc3-2f61edbe405c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:53.650300 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-700b0401-f280-4806-afc3-2f61edbe405c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:53.657033 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-700b0401-f280-4806-afc3-2f61edbe405c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:53.657636 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-700b0401-f280-4806-afc3-2f61edbe405c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:53.658399 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-700b0401-f280-4806-afc3-2f61edbe405c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:53.658883 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-700b0401-f280-4806-afc3-2f61edbe405c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:53.832888 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-575d0232-e244-442c-819c-bc020769e994 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:53.833373 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-700b0401-f280-4806-afc3-2f61edbe405c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:53.843273 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-575d0232-e244-442c-819c-bc020769e994 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] [instance: 363118dd-a0c3-444f-99cb-f0578407e0d2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:53.861386 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-700b0401-f280-4806-afc3-2f61edbe405c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:53.866008 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-700b0401-f280-4806-afc3-2f61edbe405c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:53.871263 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-700b0401-f280-4806-afc3-2f61edbe405c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1750 microversion: 2.20 time: 0.221394 Aug 03 05:15:53.872688 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 177/367] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:15:53 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1750 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:15:53.925852 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-575d0232-e244-442c-819c-bc020769e994 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79539af2999d48baa11734ced32dccb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d7bf6baa2224b0d910133c5542608e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:53.934015 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-575d0232-e244-442c-819c-bc020769e994 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2" status: 200 len: 1258 microversion: 2.1 time: 0.105195 Aug 03 05:15:53.935172 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 191/368] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:53 2022] GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2 => generated 1258 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:15:54.903558 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-1302a253-6ef9-4adb-910c-023acd89fc9c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:54.905902 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-1302a253-6ef9-4adb-910c-023acd89fc9c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:54.915136 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-1302a253-6ef9-4adb-910c-023acd89fc9c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:54.915832 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-1302a253-6ef9-4adb-910c-023acd89fc9c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:54.916980 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-1302a253-6ef9-4adb-910c-023acd89fc9c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:54.919704 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-1302a253-6ef9-4adb-910c-023acd89fc9c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:54.956017 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-d71aa859-529b-44a1-ba3f-11c56bb4889a tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:54.957283 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-d71aa859-529b-44a1-ba3f-11c56bb4889a tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] [instance: 363118dd-a0c3-444f-99cb-f0578407e0d2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:54.964243 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d71aa859-529b-44a1-ba3f-11c56bb4889a tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:54.964703 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d71aa859-529b-44a1-ba3f-11c56bb4889a tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:54.968717 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d71aa859-529b-44a1-ba3f-11c56bb4889a tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:54.968717 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d71aa859-529b-44a1-ba3f-11c56bb4889a tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:55.056554 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-d71aa859-529b-44a1-ba3f-11c56bb4889a tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79539af2999d48baa11734ced32dccb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d7bf6baa2224b0d910133c5542608e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:55.071705 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-d71aa859-529b-44a1-ba3f-11c56bb4889a tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2" status: 200 len: 1254 microversion: 2.1 time: 0.116452 Aug 03 05:15:55.082794 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 192/369] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:54 2022] GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2 => generated 1254 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:15:55.113171 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-1302a253-6ef9-4adb-910c-023acd89fc9c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:55.124773 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-1302a253-6ef9-4adb-910c-023acd89fc9c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:55.126494 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-1302a253-6ef9-4adb-910c-023acd89fc9c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:55.127703 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-1302a253-6ef9-4adb-910c-023acd89fc9c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1750 microversion: 2.20 time: 0.234604 Aug 03 05:15:55.128385 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 178/370] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:15:54 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1750 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:15:56.091525 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-650a23cd-eeed-4c64-9af1-4fa81a0d777d tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:56.092382 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-650a23cd-eeed-4c64-9af1-4fa81a0d777d tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] [instance: 363118dd-a0c3-444f-99cb-f0578407e0d2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:56.105414 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-650a23cd-eeed-4c64-9af1-4fa81a0d777d tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:56.106782 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-650a23cd-eeed-4c64-9af1-4fa81a0d777d tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:56.110295 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-650a23cd-eeed-4c64-9af1-4fa81a0d777d tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:56.110687 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-650a23cd-eeed-4c64-9af1-4fa81a0d777d tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:56.152725 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-f1af0e22-d5eb-4c9f-bcef-b738ca5f9ab1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:56.153336 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-f1af0e22-d5eb-4c9f-bcef-b738ca5f9ab1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:56.159540 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f1af0e22-d5eb-4c9f-bcef-b738ca5f9ab1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:56.160316 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f1af0e22-d5eb-4c9f-bcef-b738ca5f9ab1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:56.161293 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f1af0e22-d5eb-4c9f-bcef-b738ca5f9ab1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:56.161933 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f1af0e22-d5eb-4c9f-bcef-b738ca5f9ab1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:56.237295 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-650a23cd-eeed-4c64-9af1-4fa81a0d777d tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79539af2999d48baa11734ced32dccb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d7bf6baa2224b0d910133c5542608e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:56.246637 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-650a23cd-eeed-4c64-9af1-4fa81a0d777d tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2" status: 200 len: 1318 microversion: 2.1 time: 0.159286 Aug 03 05:15:56.251469 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 193/371] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:56 2022] GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:56.412465 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-f1af0e22-d5eb-4c9f-bcef-b738ca5f9ab1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:56.426893 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-f1af0e22-d5eb-4c9f-bcef-b738ca5f9ab1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:56.428594 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-f1af0e22-d5eb-4c9f-bcef-b738ca5f9ab1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:56.429771 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-f1af0e22-d5eb-4c9f-bcef-b738ca5f9ab1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1806 microversion: 2.20 time: 0.281147 Aug 03 05:15:56.430327 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 179/372] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:15:56 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1806 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 05:15:57.273447 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-59e52373-5cfb-4374-a0cc-0e7936b4012a tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:57.274099 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-59e52373-5cfb-4374-a0cc-0e7936b4012a tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] [instance: 363118dd-a0c3-444f-99cb-f0578407e0d2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:57.291263 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-59e52373-5cfb-4374-a0cc-0e7936b4012a tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:57.291710 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-59e52373-5cfb-4374-a0cc-0e7936b4012a tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:57.293330 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-59e52373-5cfb-4374-a0cc-0e7936b4012a tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:57.293983 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-59e52373-5cfb-4374-a0cc-0e7936b4012a tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:57.314861 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:15:57.382213 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-59e52373-5cfb-4374-a0cc-0e7936b4012a tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79539af2999d48baa11734ced32dccb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d7bf6baa2224b0d910133c5542608e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:57.389956 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-59e52373-5cfb-4374-a0cc-0e7936b4012a tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2" status: 200 len: 1316 microversion: 2.1 time: 0.120278 Aug 03 05:15:57.390536 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 194/373] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:57 2022] GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2 => generated 1316 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:57.454221 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-066c1d66-be24-48aa-ba2a-5c221363bba5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:57.454828 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-066c1d66-be24-48aa-ba2a-5c221363bba5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:57.472266 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-066c1d66-be24-48aa-ba2a-5c221363bba5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:57.473060 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-066c1d66-be24-48aa-ba2a-5c221363bba5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:57.476598 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-066c1d66-be24-48aa-ba2a-5c221363bba5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:57.476598 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-066c1d66-be24-48aa-ba2a-5c221363bba5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:58.140222 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-066c1d66-be24-48aa-ba2a-5c221363bba5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:58.155900 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-066c1d66-be24-48aa-ba2a-5c221363bba5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:58.158009 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-066c1d66-be24-48aa-ba2a-5c221363bba5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:58.164936 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-066c1d66-be24-48aa-ba2a-5c221363bba5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1806 microversion: 2.20 time: 0.714789 Aug 03 05:15:58.168839 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 180/374] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:15:57 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1806 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:15:58.414375 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-dceca954-1cfa-44c1-8298-124186f5b8ea tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:58.415061 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-dceca954-1cfa-44c1-8298-124186f5b8ea tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] [instance: 363118dd-a0c3-444f-99cb-f0578407e0d2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:58.427210 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-dceca954-1cfa-44c1-8298-124186f5b8ea tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:58.428548 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-dceca954-1cfa-44c1-8298-124186f5b8ea tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:58.431161 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-dceca954-1cfa-44c1-8298-124186f5b8ea tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:58.433426 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-dceca954-1cfa-44c1-8298-124186f5b8ea tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:58.708582 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-dceca954-1cfa-44c1-8298-124186f5b8ea tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79539af2999d48baa11734ced32dccb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d7bf6baa2224b0d910133c5542608e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:58.719287 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-dceca954-1cfa-44c1-8298-124186f5b8ea tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2" status: 200 len: 1358 microversion: 2.1 time: 0.309400 Aug 03 05:15:58.720652 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 195/375] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:58 2022] GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2 => generated 1358 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:58.966092 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-c71a2245-6640-44a8-8857-e3390072d931 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-816928799", "imageRef": "37d7ad4a-d925-48e6-84af-ec878f19050e", "flavorRef": "452"}} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:15:59.190323 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-b4442665-de09-4044-8f44-786f65c6a55f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:59.190986 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-b4442665-de09-4044-8f44-786f65c6a55f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:59.197243 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b4442665-de09-4044-8f44-786f65c6a55f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:59.197700 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b4442665-de09-4044-8f44-786f65c6a55f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:59.198470 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b4442665-de09-4044-8f44-786f65c6a55f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:59.198936 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b4442665-de09-4044-8f44-786f65c6a55f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:59.353732 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-b4442665-de09-4044-8f44-786f65c6a55f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:59.370095 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-b4442665-de09-4044-8f44-786f65c6a55f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:59.372271 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-b4442665-de09-4044-8f44-786f65c6a55f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:59.373689 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-b4442665-de09-4044-8f44-786f65c6a55f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1806 microversion: 2.20 time: 0.187469 Aug 03 05:15:59.379461 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 196/376] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:15:59 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1806 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:15:59.476299 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-56f39578-6607-4b18-83d1-89e6c73ffdbb req-8fee240d-ce03-4cd0-81cf-03f8d324b10f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "363118dd-a0c3-444f-99cb-f0578407e0d2", "tag": "1d2d095e-7779-4335-a8cf-cbd4d15b643b"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:15:59.483467 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:15:59.490447 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-56f39578-6607-4b18-83d1-89e6c73ffdbb req-8fee240d-ce03-4cd0-81cf-03f8d324b10f service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:59.491513 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-56f39578-6607-4b18-83d1-89e6c73ffdbb req-8fee240d-ce03-4cd0-81cf-03f8d324b10f service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:59.506240 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-56f39578-6607-4b18-83d1-89e6c73ffdbb req-8fee240d-ce03-4cd0-81cf-03f8d324b10f service nova] Creating event network-changed:1d2d095e-7779-4335-a8cf-cbd4d15b643b for instance 363118dd-a0c3-444f-99cb-f0578407e0d2 on hv-cinder-85127 Aug 03 05:15:59.513301 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-56f39578-6607-4b18-83d1-89e6c73ffdbb req-8fee240d-ce03-4cd0-81cf-03f8d324b10f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041537 Aug 03 05:15:59.514225 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 197/377] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:15:59.755030 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-590c7ec5-1838-4e1f-87d4-a4be79d0badd tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:59.756163 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-590c7ec5-1838-4e1f-87d4-a4be79d0badd tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] [instance: 363118dd-a0c3-444f-99cb-f0578407e0d2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:59.764167 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-590c7ec5-1838-4e1f-87d4-a4be79d0badd tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:59.764870 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-590c7ec5-1838-4e1f-87d4-a4be79d0badd tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:59.765882 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-590c7ec5-1838-4e1f-87d4-a4be79d0badd tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:59.766511 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-590c7ec5-1838-4e1f-87d4-a4be79d0badd tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:59.981184 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-590c7ec5-1838-4e1f-87d4-a4be79d0badd tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79539af2999d48baa11734ced32dccb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d7bf6baa2224b0d910133c5542608e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:59.993532 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-590c7ec5-1838-4e1f-87d4-a4be79d0badd tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2" status: 200 len: 1358 microversion: 2.1 time: 0.242987 Aug 03 05:16:00.001762 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 198/378] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:59 2022] GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2 => generated 1358 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:16:00.327782 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-685933a9-3980-4bd6-9328-b81b3856af37 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1540758098", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1654296735", "security_groups": [{"name": "tempest-secgroup-smoke-920195612"}], "networks": [{"uuid": "bbb5d950-6a24-4342-b6f3-55bde0214ab1"}], "block_device_mapping_v2": [{"uuid": "b7f15d81-3d36-4951-ac9f-b7e315815e3e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:16:00.480142 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.network.neutron [None req-685933a9-3980-4bd6-9328-b81b3856af37 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] validate_networks() for [('bbb5d950-6a24-4342-b6f3-55bde0214ab1', None, None, None, None, None)] {{(pid=118331) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:16:01.087625 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-685933a9-3980-4bd6-9328-b81b3856af37 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Flavor limits 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:16:01.088429 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-685933a9-3980-4bd6-9328-b81b3856af37 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Image limits 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:16:01.089678 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-685933a9-3980-4bd6-9328-b81b3856af37 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Flavor pref 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:16:01.090248 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-685933a9-3980-4bd6-9328-b81b3856af37 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Image pref 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:16:01.090997 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-685933a9-3980-4bd6-9328-b81b3856af37 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:16:01.107598 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-685933a9-3980-4bd6-9328-b81b3856af37 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:01.108301 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-685933a9-3980-4bd6-9328-b81b3856af37 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:01.109415 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-685933a9-3980-4bd6-9328-b81b3856af37 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:01.110101 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-685933a9-3980-4bd6-9328-b81b3856af37 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:01.132896 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-685933a9-3980-4bd6-9328-b81b3856af37 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Getting quotas for project 6ff6f2c611f44256a7d85a8d99981d9d. Resources: {'instances', 'ram', 'cores'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:16:01.138068 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-685933a9-3980-4bd6-9328-b81b3856af37 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Getting quotas for user f145cffb3c4d4965a35553b95b316f56 and project 6ff6f2c611f44256a7d85a8d99981d9d. Resources: {'instances', 'ram', 'cores'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:16:01.217196 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-685933a9-3980-4bd6-9328-b81b3856af37 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Going to run 1 instances... {{(pid=118331) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:16:01.219455 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-685933a9-3980-4bd6-9328-b81b3856af37 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b7f15d81-3d36-4951-ac9f-b7e315815e3e',volume_size=None,volume_type=None)] {{(pid=118331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:16:01.747304 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-685933a9-3980-4bd6-9328-b81b3856af37 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.424379 Aug 03 05:16:01.755402 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 199/379] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Aug 3 05:16:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 1433 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 05:16:01.765907 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-3d0b7e63-0a54-4903-92d7-5a1c7ac94d36 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:01.765907 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-3d0b7e63-0a54-4903-92d7-5a1c7ac94d36 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:01.772010 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3d0b7e63-0a54-4903-92d7-5a1c7ac94d36 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:01.772010 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3d0b7e63-0a54-4903-92d7-5a1c7ac94d36 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:01.772010 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3d0b7e63-0a54-4903-92d7-5a1c7ac94d36 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:01.772010 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3d0b7e63-0a54-4903-92d7-5a1c7ac94d36 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:02.003910 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-3d0b7e63-0a54-4903-92d7-5a1c7ac94d36 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:02.020412 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-3d0b7e63-0a54-4903-92d7-5a1c7ac94d36 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:02.022217 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-3d0b7e63-0a54-4903-92d7-5a1c7ac94d36 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:02.023710 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-3d0b7e63-0a54-4903-92d7-5a1c7ac94d36 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1806 microversion: 2.20 time: 0.267016 Aug 03 05:16:02.024816 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 200/380] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:16:01 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1806 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:16:02.030381 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-2a94e7dd-d9cc-46d6-927a-8f5e3b9f8bab tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:02.031283 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-2a94e7dd-d9cc-46d6-927a-8f5e3b9f8bab tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] [instance: 363118dd-a0c3-444f-99cb-f0578407e0d2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:02.038388 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2a94e7dd-d9cc-46d6-927a-8f5e3b9f8bab tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:02.039198 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2a94e7dd-d9cc-46d6-927a-8f5e3b9f8bab tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:02.040212 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2a94e7dd-d9cc-46d6-927a-8f5e3b9f8bab tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:02.040881 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2a94e7dd-d9cc-46d6-927a-8f5e3b9f8bab tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:02.276837 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-2a94e7dd-d9cc-46d6-927a-8f5e3b9f8bab tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79539af2999d48baa11734ced32dccb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d7bf6baa2224b0d910133c5542608e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:02.276837 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-2a94e7dd-d9cc-46d6-927a-8f5e3b9f8bab tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2" status: 200 len: 1358 microversion: 2.1 time: 0.200049 Aug 03 05:16:02.276837 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 201/381] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:02 2022] GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2 => generated 1358 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:02.276837 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-0c2bb435-7c07-4523-9468-b3bfd5427cde tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:02.277262 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-0c2bb435-7c07-4523-9468-b3bfd5427cde tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:02.295832 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-0c2bb435-7c07-4523-9468-b3bfd5427cde tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:02.303220 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-0c2bb435-7c07-4523-9468-b3bfd5427cde tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1089 microversion: 2.1 time: 0.075359 Aug 03 05:16:02.312936 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 202/382] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:02 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1089 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:02.441518 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_cell0:SELECT=2 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:16:02.467302 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_cell0:SELECT=6 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:16:03.054724 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-4c98d2e9-57dc-4236-a1d0-c67caf65ff74 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:03.054724 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-4c98d2e9-57dc-4236-a1d0-c67caf65ff74 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:03.057541 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4c98d2e9-57dc-4236-a1d0-c67caf65ff74 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:03.058722 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4c98d2e9-57dc-4236-a1d0-c67caf65ff74 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:03.059706 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4c98d2e9-57dc-4236-a1d0-c67caf65ff74 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:03.060336 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4c98d2e9-57dc-4236-a1d0-c67caf65ff74 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:03.305832 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-4c98d2e9-57dc-4236-a1d0-c67caf65ff74 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:03.317633 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-4c98d2e9-57dc-4236-a1d0-c67caf65ff74 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:03.321462 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-4c98d2e9-57dc-4236-a1d0-c67caf65ff74 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:03.324073 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-4c98d2e9-57dc-4236-a1d0-c67caf65ff74 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1806 microversion: 2.20 time: 0.278468 Aug 03 05:16:03.331316 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 203/383] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:16:03 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1806 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 05:16:03.337529 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-a4a896fb-e937-4d79-817a-b0b9a4e0071b tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:03.338349 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-a4a896fb-e937-4d79-817a-b0b9a4e0071b tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] [instance: 363118dd-a0c3-444f-99cb-f0578407e0d2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:03.350744 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a4a896fb-e937-4d79-817a-b0b9a4e0071b tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:03.351227 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a4a896fb-e937-4d79-817a-b0b9a4e0071b tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:03.352199 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a4a896fb-e937-4d79-817a-b0b9a4e0071b tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:03.353205 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a4a896fb-e937-4d79-817a-b0b9a4e0071b tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:03.542606 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-a4a896fb-e937-4d79-817a-b0b9a4e0071b tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79539af2999d48baa11734ced32dccb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d7bf6baa2224b0d910133c5542608e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:03.550365 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-a4a896fb-e937-4d79-817a-b0b9a4e0071b tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2" status: 200 len: 1358 microversion: 2.1 time: 0.217148 Aug 03 05:16:03.554926 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 204/384] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:03 2022] GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2 => generated 1358 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:03.556376 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-dad96e07-1ac7-4a71-9735-49e38487d8c1 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:03.557257 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-dad96e07-1ac7-4a71-9735-49e38487d8c1 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:03.628832 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-dad96e07-1ac7-4a71-9735-49e38487d8c1 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:03.638703 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-dad96e07-1ac7-4a71-9735-49e38487d8c1 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1089 microversion: 2.1 time: 0.086228 Aug 03 05:16:03.639400 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 205/385] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:03 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1089 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:04.352282 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-da46d2b0-51cf-4e99-9685-49a35218ee5e tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:04.353161 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-da46d2b0-51cf-4e99-9685-49a35218ee5e tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:04.361679 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-da46d2b0-51cf-4e99-9685-49a35218ee5e tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:04.362232 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-da46d2b0-51cf-4e99-9685-49a35218ee5e tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:04.363247 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-da46d2b0-51cf-4e99-9685-49a35218ee5e tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:04.363905 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-da46d2b0-51cf-4e99-9685-49a35218ee5e tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:04.515671 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-da46d2b0-51cf-4e99-9685-49a35218ee5e tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:04.524715 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-da46d2b0-51cf-4e99-9685-49a35218ee5e tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:04.527172 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-da46d2b0-51cf-4e99-9685-49a35218ee5e tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:04.528415 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-da46d2b0-51cf-4e99-9685-49a35218ee5e tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1806 microversion: 2.20 time: 0.180106 Aug 03 05:16:04.529456 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 206/386] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:16:04 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1806 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 05:16:04.573613 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-a9d4498f-8fc2-4b0f-b81f-47a6f446de07 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:04.574606 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-a9d4498f-8fc2-4b0f-b81f-47a6f446de07 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] [instance: 363118dd-a0c3-444f-99cb-f0578407e0d2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:04.580744 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a9d4498f-8fc2-4b0f-b81f-47a6f446de07 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:04.581484 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a9d4498f-8fc2-4b0f-b81f-47a6f446de07 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:04.581939 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a9d4498f-8fc2-4b0f-b81f-47a6f446de07 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:04.582375 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a9d4498f-8fc2-4b0f-b81f-47a6f446de07 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:04.752615 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-a9d4498f-8fc2-4b0f-b81f-47a6f446de07 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79539af2999d48baa11734ced32dccb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d7bf6baa2224b0d910133c5542608e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:04.765116 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-a9d4498f-8fc2-4b0f-b81f-47a6f446de07 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2" status: 200 len: 1358 microversion: 2.1 time: 0.195812 Aug 03 05:16:04.766293 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 207/387] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:04 2022] GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2 => generated 1358 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:04.770953 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-e047a2ea-dcf0-451e-a695-8260066248cb tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:04.771564 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-e047a2ea-dcf0-451e-a695-8260066248cb tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:04.778728 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e047a2ea-dcf0-451e-a695-8260066248cb tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:04.779231 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e047a2ea-dcf0-451e-a695-8260066248cb tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:04.780017 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e047a2ea-dcf0-451e-a695-8260066248cb tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:04.780455 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e047a2ea-dcf0-451e-a695-8260066248cb tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:04.852309 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-e047a2ea-dcf0-451e-a695-8260066248cb tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:04.861304 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-e047a2ea-dcf0-451e-a695-8260066248cb tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1139 microversion: 2.1 time: 0.093839 Aug 03 05:16:04.862316 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 208/388] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:04 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1139 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:05.553699 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-0ac958a7-1f54-40d7-ac86-125d7167a96c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:05.554365 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-0ac958a7-1f54-40d7-ac86-125d7167a96c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:05.561953 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0ac958a7-1f54-40d7-ac86-125d7167a96c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:05.562418 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0ac958a7-1f54-40d7-ac86-125d7167a96c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:05.563301 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0ac958a7-1f54-40d7-ac86-125d7167a96c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:05.563750 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0ac958a7-1f54-40d7-ac86-125d7167a96c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:05.803308 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-0ac958a7-1f54-40d7-ac86-125d7167a96c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:05.826935 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-0ac958a7-1f54-40d7-ac86-125d7167a96c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:05.826935 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-0ac958a7-1f54-40d7-ac86-125d7167a96c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:05.827423 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-0ac958a7-1f54-40d7-ac86-125d7167a96c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1806 microversion: 2.20 time: 0.277178 Aug 03 05:16:05.828527 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 209/389] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:16:05 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1806 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:16:05.833356 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-4013a03d-5e6c-4a1e-b7e3-a8772cf51a3a tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:05.834226 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-4013a03d-5e6c-4a1e-b7e3-a8772cf51a3a tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] [instance: 363118dd-a0c3-444f-99cb-f0578407e0d2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:05.841772 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4013a03d-5e6c-4a1e-b7e3-a8772cf51a3a tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:05.842532 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4013a03d-5e6c-4a1e-b7e3-a8772cf51a3a tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:05.843550 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4013a03d-5e6c-4a1e-b7e3-a8772cf51a3a tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:05.844192 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4013a03d-5e6c-4a1e-b7e3-a8772cf51a3a tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:06.077753 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-4013a03d-5e6c-4a1e-b7e3-a8772cf51a3a tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79539af2999d48baa11734ced32dccb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d7bf6baa2224b0d910133c5542608e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:06.089539 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-4013a03d-5e6c-4a1e-b7e3-a8772cf51a3a tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2" status: 200 len: 1358 microversion: 2.1 time: 0.258985 Aug 03 05:16:06.090449 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 210/390] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:05 2022] GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2 => generated 1358 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:06.095618 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-5dcab692-8fb1-4a4d-95b3-7de223a8225d tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:06.096226 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-5dcab692-8fb1-4a4d-95b3-7de223a8225d tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:06.102626 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5dcab692-8fb1-4a4d-95b3-7de223a8225d tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:06.103153 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5dcab692-8fb1-4a4d-95b3-7de223a8225d tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:06.103936 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5dcab692-8fb1-4a4d-95b3-7de223a8225d tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:06.104507 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5dcab692-8fb1-4a4d-95b3-7de223a8225d tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:06.203162 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-5dcab692-8fb1-4a4d-95b3-7de223a8225d tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:06.213216 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-5dcab692-8fb1-4a4d-95b3-7de223a8225d tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1139 microversion: 2.1 time: 0.121666 Aug 03 05:16:06.215820 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 211/391] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:06 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1139 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:06.869612 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-688ee144-fa81-4c68-8d79-ee549d310d15 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:06.871960 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-688ee144-fa81-4c68-8d79-ee549d310d15 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:06.879886 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-688ee144-fa81-4c68-8d79-ee549d310d15 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:06.880327 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-688ee144-fa81-4c68-8d79-ee549d310d15 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:06.881106 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-688ee144-fa81-4c68-8d79-ee549d310d15 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:06.881554 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-688ee144-fa81-4c68-8d79-ee549d310d15 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:07.044108 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-688ee144-fa81-4c68-8d79-ee549d310d15 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:07.053251 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-688ee144-fa81-4c68-8d79-ee549d310d15 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:07.054766 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-688ee144-fa81-4c68-8d79-ee549d310d15 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:07.055974 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-688ee144-fa81-4c68-8d79-ee549d310d15 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1806 microversion: 2.20 time: 0.190419 Aug 03 05:16:07.056848 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 212/392] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:16:06 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1806 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 05:16:07.111548 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-ffe9860c-d247-4e89-a7f4-ab1acafa1a3a tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:07.112164 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-ffe9860c-d247-4e89-a7f4-ab1acafa1a3a tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] [instance: 363118dd-a0c3-444f-99cb-f0578407e0d2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:07.120960 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ffe9860c-d247-4e89-a7f4-ab1acafa1a3a tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:07.121418 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ffe9860c-d247-4e89-a7f4-ab1acafa1a3a tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:07.122318 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ffe9860c-d247-4e89-a7f4-ab1acafa1a3a tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:07.122661 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ffe9860c-d247-4e89-a7f4-ab1acafa1a3a tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:07.276475 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-ffe9860c-d247-4e89-a7f4-ab1acafa1a3a tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79539af2999d48baa11734ced32dccb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d7bf6baa2224b0d910133c5542608e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:07.284340 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-ffe9860c-d247-4e89-a7f4-ab1acafa1a3a tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2" status: 200 len: 1358 microversion: 2.1 time: 0.176787 Aug 03 05:16:07.288336 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 213/393] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:07 2022] GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:16:07.289504 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-ff522630-9a96-482a-a9b9-33052be7c18e tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:07.290119 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-ff522630-9a96-482a-a9b9-33052be7c18e tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:07.296644 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ff522630-9a96-482a-a9b9-33052be7c18e tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:07.297096 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ff522630-9a96-482a-a9b9-33052be7c18e tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:07.297875 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ff522630-9a96-482a-a9b9-33052be7c18e tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:07.298318 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ff522630-9a96-482a-a9b9-33052be7c18e tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:07.324645 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=100 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:16:07.371016 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-ff522630-9a96-482a-a9b9-33052be7c18e tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:07.378927 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-ff522630-9a96-482a-a9b9-33052be7c18e tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1139 microversion: 2.1 time: 0.093013 Aug 03 05:16:07.379503 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 214/394] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:07 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1139 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:08.035715 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-db40d6cf-d52f-4205-9ba0-cb6003cbb8d1 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2128739630", "imageRef": "37d7ad4a-d925-48e6-84af-ec878f19050e", "flavorRef": "452", "networks": [{"uuid": "ec3d5553-9ecc-44aa-8db9-0f957032655c"}]}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:16:08.144634 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_cell1:SELECT=26 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:16:08.982413 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:16:09.752111 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.network.neutron [None req-c71a2245-6640-44a8-8857-e3390072d931 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] validate_networks() for None {{(pid=118332) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:16:09.758107 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.network.neutron [None req-db40d6cf-d52f-4205-9ba0-cb6003cbb8d1 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] validate_networks() for [('ec3d5553-9ecc-44aa-8db9-0f957032655c', None, None, None, None, None)] {{(pid=118331) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:16:10.184293 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.virt.hardware [None req-c71a2245-6640-44a8-8857-e3390072d931 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Flavor limits 0:0:0 {{(pid=118332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:16:10.184720 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.virt.hardware [None req-c71a2245-6640-44a8-8857-e3390072d931 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Image limits 0:0:0 {{(pid=118332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:16:10.185361 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.virt.hardware [None req-c71a2245-6640-44a8-8857-e3390072d931 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Flavor pref 0:0:0 {{(pid=118332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:16:10.185774 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.virt.hardware [None req-c71a2245-6640-44a8-8857-e3390072d931 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Image pref 0:0:0 {{(pid=118332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:16:10.186187 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.virt.hardware [None req-c71a2245-6640-44a8-8857-e3390072d931 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:16:10.196826 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-c71a2245-6640-44a8-8857-e3390072d931 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:10.197270 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-c71a2245-6640-44a8-8857-e3390072d931 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:10.199675 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-c71a2245-6640-44a8-8857-e3390072d931 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:10.199675 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-c71a2245-6640-44a8-8857-e3390072d931 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:10.216634 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.quota [None req-c71a2245-6640-44a8-8857-e3390072d931 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Getting quotas for project 7a970d4cbb3545a187c75848e10cb166. Resources: {'instances', 'ram', 'cores'} {{(pid=118332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:16:10.220346 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.quota [None req-c71a2245-6640-44a8-8857-e3390072d931 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Getting quotas for user ff504c0570b24f3baa8744a9740bcfce and project 7a970d4cbb3545a187c75848e10cb166. Resources: {'instances', 'ram', 'cores'} {{(pid=118332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:16:10.232270 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-c71a2245-6640-44a8-8857-e3390072d931 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Going to run 1 instances... {{(pid=118332) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:16:10.234703 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-c71a2245-6640-44a8-8857-e3390072d931 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] [instance: a21965b8-51d4-4bb6-afb7-053298242bfa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37d7ad4a-d925-48e6-84af-ec878f19050e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:16:10.382360 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-db40d6cf-d52f-4205-9ba0-cb6003cbb8d1 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Flavor limits 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:16:10.383098 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-db40d6cf-d52f-4205-9ba0-cb6003cbb8d1 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Image limits 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:16:10.383791 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-db40d6cf-d52f-4205-9ba0-cb6003cbb8d1 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Flavor pref 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:16:10.384241 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-db40d6cf-d52f-4205-9ba0-cb6003cbb8d1 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Image pref 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:16:10.384679 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-db40d6cf-d52f-4205-9ba0-cb6003cbb8d1 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:16:10.403776 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-db40d6cf-d52f-4205-9ba0-cb6003cbb8d1 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:10.404258 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-db40d6cf-d52f-4205-9ba0-cb6003cbb8d1 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:10.408560 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-db40d6cf-d52f-4205-9ba0-cb6003cbb8d1 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:10.408560 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-db40d6cf-d52f-4205-9ba0-cb6003cbb8d1 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:10.410115 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-c71a2245-6640-44a8-8857-e3390072d931 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 11.449436 Aug 03 05:16:10.414882 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 181/395] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Aug 3 05:15:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 11451 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 05:16:10.418289 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-b7f0ff1b-132b-419a-b063-dc5f7c0ceb3e tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:10.418926 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-b7f0ff1b-132b-419a-b063-dc5f7c0ceb3e tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:10.434000 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b7f0ff1b-132b-419a-b063-dc5f7c0ceb3e tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:10.434469 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b7f0ff1b-132b-419a-b063-dc5f7c0ceb3e tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:10.435306 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b7f0ff1b-132b-419a-b063-dc5f7c0ceb3e tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:10.435753 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b7f0ff1b-132b-419a-b063-dc5f7c0ceb3e tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:10.456306 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-db40d6cf-d52f-4205-9ba0-cb6003cbb8d1 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Getting quotas for project 6675985e19c44dabb624420aaa97b0f7. Resources: {'instances', 'ram', 'cores'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:16:10.461598 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-db40d6cf-d52f-4205-9ba0-cb6003cbb8d1 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Getting quotas for user 28d7d91983dc4c0fb218e7bdbc1c6558 and project 6675985e19c44dabb624420aaa97b0f7. Resources: {'instances', 'ram', 'cores'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:16:10.476278 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-db40d6cf-d52f-4205-9ba0-cb6003cbb8d1 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Going to run 1 instances... {{(pid=118331) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:16:10.478765 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-db40d6cf-d52f-4205-9ba0-cb6003cbb8d1 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] [instance: fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37d7ad4a-d925-48e6-84af-ec878f19050e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:16:10.634758 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-db40d6cf-d52f-4205-9ba0-cb6003cbb8d1 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.602769 Aug 03 05:16:10.635466 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 215/396] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Aug 3 05:16:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 2604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 05:16:10.642886 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-244174c5-b9fd-4bee-bd4e-d9980b639ac0 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:10.642886 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-244174c5-b9fd-4bee-bd4e-d9980b639ac0 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] [instance: 363118dd-a0c3-444f-99cb-f0578407e0d2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:10.652727 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-244174c5-b9fd-4bee-bd4e-d9980b639ac0 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:10.653097 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-244174c5-b9fd-4bee-bd4e-d9980b639ac0 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:10.653802 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-244174c5-b9fd-4bee-bd4e-d9980b639ac0 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:10.654241 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-244174c5-b9fd-4bee-bd4e-d9980b639ac0 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:10.682180 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-b7f0ff1b-132b-419a-b063-dc5f7c0ceb3e tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:10.691441 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-b7f0ff1b-132b-419a-b063-dc5f7c0ceb3e tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:10.694112 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-b7f0ff1b-132b-419a-b063-dc5f7c0ceb3e tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:10.708792 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-b7f0ff1b-132b-419a-b063-dc5f7c0ceb3e tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1806 microversion: 2.20 time: 0.283883 Aug 03 05:16:10.727022 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 182/397] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:16:10 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1806 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:16:10.728369 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-704bb90b-ba31-4749-a011-dd0cd352705c tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:10.729187 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-704bb90b-ba31-4749-a011-dd0cd352705c tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:10.740327 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-704bb90b-ba31-4749-a011-dd0cd352705c tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:10.741179 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-704bb90b-ba31-4749-a011-dd0cd352705c tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:10.742262 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-704bb90b-ba31-4749-a011-dd0cd352705c tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:10.743063 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-704bb90b-ba31-4749-a011-dd0cd352705c tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:10.858014 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-704bb90b-ba31-4749-a011-dd0cd352705c tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:10.872077 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-704bb90b-ba31-4749-a011-dd0cd352705c tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1139 microversion: 2.1 time: 0.159540 Aug 03 05:16:10.873371 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 183/398] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:10 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1139 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:10.879769 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-694b3c74-4cfc-43d7-9097-5d3f35aaaf0e tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:10.880608 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-694b3c74-4cfc-43d7-9097-5d3f35aaaf0e tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] [instance: a21965b8-51d4-4bb6-afb7-053298242bfa] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:10.890441 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-244174c5-b9fd-4bee-bd4e-d9980b639ac0 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79539af2999d48baa11734ced32dccb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d7bf6baa2224b0d910133c5542608e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:10.899307 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-244174c5-b9fd-4bee-bd4e-d9980b639ac0 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2" status: 200 len: 1358 microversion: 2.1 time: 0.262194 Aug 03 05:16:10.900228 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 216/399] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:10 2022] GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2 => generated 1358 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:10.905920 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-48301730-b090-4908-87ee-4da0aeb6984d tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:10.906539 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-48301730-b090-4908-87ee-4da0aeb6984d tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] [instance: fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:10.967409 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-694b3c74-4cfc-43d7-9097-5d3f35aaaf0e tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff504c0570b24f3baa8744a9740bcfce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a970d4cbb3545a187c75848e10cb166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:10.978756 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-694b3c74-4cfc-43d7-9097-5d3f35aaaf0e tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] 10.222.0.40 "GET /compute/v2.1/servers/a21965b8-51d4-4bb6-afb7-053298242bfa" status: 200 len: 1214 microversion: 2.1 time: 0.104083 Aug 03 05:16:10.979523 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 184/400] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:10 2022] GET /compute/v2.1/servers/a21965b8-51d4-4bb6-afb7-053298242bfa => generated 1214 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:10.997261 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-48301730-b090-4908-87ee-4da0aeb6984d tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7d91983dc4c0fb218e7bdbc1c6558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6675985e19c44dabb624420aaa97b0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:11.004786 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-48301730-b090-4908-87ee-4da0aeb6984d tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] 10.222.0.40 "GET /compute/v2.1/servers/fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5" status: 200 len: 1219 microversion: 2.1 time: 0.103436 Aug 03 05:16:11.022482 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 217/401] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:10 2022] GET /compute/v2.1/servers/fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5 => generated 1219 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:11.741564 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-b66ecc8e-d442-4e91-85eb-a6129a232dfc tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:11.742155 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-b66ecc8e-d442-4e91-85eb-a6129a232dfc tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:11.748344 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b66ecc8e-d442-4e91-85eb-a6129a232dfc tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:11.752303 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b66ecc8e-d442-4e91-85eb-a6129a232dfc tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:11.752303 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b66ecc8e-d442-4e91-85eb-a6129a232dfc tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:11.752303 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b66ecc8e-d442-4e91-85eb-a6129a232dfc tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:11.896832 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-4628cf12-e152-453b-bbe7-2944a18b0556 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:11.898157 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-4628cf12-e152-453b-bbe7-2944a18b0556 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:11.909035 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-b66ecc8e-d442-4e91-85eb-a6129a232dfc tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:11.919648 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-b66ecc8e-d442-4e91-85eb-a6129a232dfc tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:11.921355 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-b66ecc8e-d442-4e91-85eb-a6129a232dfc tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:11.921805 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4628cf12-e152-453b-bbe7-2944a18b0556 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:11.922707 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-b66ecc8e-d442-4e91-85eb-a6129a232dfc tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1806 microversion: 2.20 time: 0.185152 Aug 03 05:16:11.923415 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4628cf12-e152-453b-bbe7-2944a18b0556 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:11.923602 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 185/402] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:16:11 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1806 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:16:11.925410 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4628cf12-e152-453b-bbe7-2944a18b0556 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:11.926223 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4628cf12-e152-453b-bbe7-2944a18b0556 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:11.929332 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-f317fedb-40aa-4664-8064-cb9f0e8aec1c tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:11.929945 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-f317fedb-40aa-4664-8064-cb9f0e8aec1c tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] [instance: 363118dd-a0c3-444f-99cb-f0578407e0d2] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:11.936247 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f317fedb-40aa-4664-8064-cb9f0e8aec1c tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:11.936941 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f317fedb-40aa-4664-8064-cb9f0e8aec1c tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:11.938487 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f317fedb-40aa-4664-8064-cb9f0e8aec1c tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:11.939134 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f317fedb-40aa-4664-8064-cb9f0e8aec1c tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:12.089975 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-4628cf12-e152-453b-bbe7-2944a18b0556 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:12.100422 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-4628cf12-e152-453b-bbe7-2944a18b0556 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1139 microversion: 2.1 time: 0.209194 Aug 03 05:16:12.106711 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 218/403] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:11 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1139 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:12.111788 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-31bb1fde-92d1-4196-afef-fa789a385eb9 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:12.112414 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-31bb1fde-92d1-4196-afef-fa789a385eb9 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] [instance: a21965b8-51d4-4bb6-afb7-053298242bfa] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:12.153030 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-f317fedb-40aa-4664-8064-cb9f0e8aec1c tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79539af2999d48baa11734ced32dccb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d7bf6baa2224b0d910133c5542608e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:12.163649 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-f317fedb-40aa-4664-8064-cb9f0e8aec1c tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2" status: 200 len: 1358 microversion: 2.1 time: 0.238703 Aug 03 05:16:12.177342 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 186/404] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:11 2022] GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2 => generated 1358 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:12.177342 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-35ca43e7-966d-4e25-8df1-b7934716efef tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:12.177342 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-35ca43e7-966d-4e25-8df1-b7934716efef tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] [instance: fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:12.191077 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-31bb1fde-92d1-4196-afef-fa789a385eb9 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff504c0570b24f3baa8744a9740bcfce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a970d4cbb3545a187c75848e10cb166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:12.201766 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-31bb1fde-92d1-4196-afef-fa789a385eb9 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] 10.222.0.40 "GET /compute/v2.1/servers/a21965b8-51d4-4bb6-afb7-053298242bfa" status: 200 len: 1214 microversion: 2.1 time: 0.093789 Aug 03 05:16:12.202954 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 219/405] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:12 2022] GET /compute/v2.1/servers/a21965b8-51d4-4bb6-afb7-053298242bfa => generated 1214 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:12.208618 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-c6113b7d-8b3d-4fc4-bcad-9ab93535a427 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:12.209348 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-c6113b7d-8b3d-4fc4-bcad-9ab93535a427 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:12.222983 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c6113b7d-8b3d-4fc4-bcad-9ab93535a427 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:12.223629 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c6113b7d-8b3d-4fc4-bcad-9ab93535a427 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:12.224511 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c6113b7d-8b3d-4fc4-bcad-9ab93535a427 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:12.225054 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c6113b7d-8b3d-4fc4-bcad-9ab93535a427 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:12.249090 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-35ca43e7-966d-4e25-8df1-b7934716efef tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7d91983dc4c0fb218e7bdbc1c6558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6675985e19c44dabb624420aaa97b0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:12.256607 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-35ca43e7-966d-4e25-8df1-b7934716efef tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] 10.222.0.40 "GET /compute/v2.1/servers/fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5" status: 200 len: 1219 microversion: 2.1 time: 0.090580 Aug 03 05:16:12.257280 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 187/406] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:12 2022] GET /compute/v2.1/servers/fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:12.441393 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.objects.instance [None req-c6113b7d-8b3d-4fc4-bcad-9ab93535a427 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lazy-loading 'services' on Instance uuid 65fc13ab-3930-4958-8f59-759ba1d047b5 {{(pid=118331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:16:12.947796 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-9276d74b-8fbc-48d0-9aab-47fdb39d939f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:12.949018 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-9276d74b-8fbc-48d0-9aab-47fdb39d939f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:12.955263 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-9276d74b-8fbc-48d0-9aab-47fdb39d939f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:12.955967 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-9276d74b-8fbc-48d0-9aab-47fdb39d939f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:12.956922 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-9276d74b-8fbc-48d0-9aab-47fdb39d939f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:12.957517 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-9276d74b-8fbc-48d0-9aab-47fdb39d939f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:13.032934 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-c6113b7d-8b3d-4fc4-bcad-9ab93535a427 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "DELETE /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5/os-volume_attachments/6a8b2125-a580-47c5-83a4-6ae61e6a6a4e" status: 202 len: 0 microversion: 2.1 time: 0.828521 Aug 03 05:16:13.033898 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 220/407] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Aug 3 05:16:12 2022] DELETE /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5/os-volume_attachments/6a8b2125-a580-47c5-83a4-6ae61e6a6a4e => generated 0 bytes in 830 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:16:13.105073 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-9276d74b-8fbc-48d0-9aab-47fdb39d939f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:13.116720 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-9276d74b-8fbc-48d0-9aab-47fdb39d939f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:13.118873 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-9276d74b-8fbc-48d0-9aab-47fdb39d939f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:13.120666 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-9276d74b-8fbc-48d0-9aab-47fdb39d939f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1806 microversion: 2.20 time: 0.176258 Aug 03 05:16:13.121296 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 188/408] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:16:12 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1806 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 05:16:13.123273 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-0beb088e-49cf-44bc-9977-93ca4ebab8d9 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:13.124060 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-0beb088e-49cf-44bc-9977-93ca4ebab8d9 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:13.141623 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0beb088e-49cf-44bc-9977-93ca4ebab8d9 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:13.142559 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0beb088e-49cf-44bc-9977-93ca4ebab8d9 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:13.143636 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0beb088e-49cf-44bc-9977-93ca4ebab8d9 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:13.144058 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0beb088e-49cf-44bc-9977-93ca4ebab8d9 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:13.188112 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-489bd8f0-1891-45d2-a54e-f5a9efa54154 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:13.189080 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-489bd8f0-1891-45d2-a54e-f5a9efa54154 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] [instance: 363118dd-a0c3-444f-99cb-f0578407e0d2] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:13.199028 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-489bd8f0-1891-45d2-a54e-f5a9efa54154 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:13.200006 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-489bd8f0-1891-45d2-a54e-f5a9efa54154 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:13.204618 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-489bd8f0-1891-45d2-a54e-f5a9efa54154 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:13.205429 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-489bd8f0-1891-45d2-a54e-f5a9efa54154 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:13.226579 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-0beb088e-49cf-44bc-9977-93ca4ebab8d9 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:13.235993 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-0beb088e-49cf-44bc-9977-93ca4ebab8d9 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1139 microversion: 2.1 time: 0.117679 Aug 03 05:16:13.250288 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 221/409] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:13 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1139 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:16:13.255502 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-cbbe91ba-6dc4-40ff-bc12-c4ea4d0bbbbd tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:13.256188 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-cbbe91ba-6dc4-40ff-bc12-c4ea4d0bbbbd tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] [instance: a21965b8-51d4-4bb6-afb7-053298242bfa] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:13.264315 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-cbbe91ba-6dc4-40ff-bc12-c4ea4d0bbbbd tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:13.274185 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-cbbe91ba-6dc4-40ff-bc12-c4ea4d0bbbbd tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:13.274185 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-cbbe91ba-6dc4-40ff-bc12-c4ea4d0bbbbd tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:13.274185 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-cbbe91ba-6dc4-40ff-bc12-c4ea4d0bbbbd tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:13.336811 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-cbbe91ba-6dc4-40ff-bc12-c4ea4d0bbbbd tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff504c0570b24f3baa8744a9740bcfce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a970d4cbb3545a187c75848e10cb166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:13.345867 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-cbbe91ba-6dc4-40ff-bc12-c4ea4d0bbbbd tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] 10.222.0.40 "GET /compute/v2.1/servers/a21965b8-51d4-4bb6-afb7-053298242bfa" status: 200 len: 1218 microversion: 2.1 time: 0.094393 Aug 03 05:16:13.346859 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 222/410] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:13 2022] GET /compute/v2.1/servers/a21965b8-51d4-4bb6-afb7-053298242bfa => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:13.352497 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-44def2e8-9e28-4c62-a473-60d208ff8511 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:13.358983 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-44def2e8-9e28-4c62-a473-60d208ff8511 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] [instance: fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:13.373341 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-44def2e8-9e28-4c62-a473-60d208ff8511 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:13.373802 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-44def2e8-9e28-4c62-a473-60d208ff8511 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:13.374596 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-44def2e8-9e28-4c62-a473-60d208ff8511 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:13.375147 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-44def2e8-9e28-4c62-a473-60d208ff8511 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:13.433443 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-489bd8f0-1891-45d2-a54e-f5a9efa54154 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79539af2999d48baa11734ced32dccb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d7bf6baa2224b0d910133c5542608e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:13.441666 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-489bd8f0-1891-45d2-a54e-f5a9efa54154 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2" status: 200 len: 1358 microversion: 2.1 time: 0.258322 Aug 03 05:16:13.442804 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 189/411] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:13 2022] GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2 => generated 1358 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:13.457585 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-44def2e8-9e28-4c62-a473-60d208ff8511 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7d91983dc4c0fb218e7bdbc1c6558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6675985e19c44dabb624420aaa97b0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:13.466712 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-44def2e8-9e28-4c62-a473-60d208ff8511 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] 10.222.0.40 "GET /compute/v2.1/servers/fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5" status: 200 len: 1223 microversion: 2.1 time: 0.118224 Aug 03 05:16:13.471577 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 223/412] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:13 2022] GET /compute/v2.1/servers/fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5 => generated 1223 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:14.152563 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-645b2a1b-e227-41b4-8fc3-0171ef910df7 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:14.154532 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-645b2a1b-e227-41b4-8fc3-0171ef910df7 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:14.165634 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-645b2a1b-e227-41b4-8fc3-0171ef910df7 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:14.167524 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-645b2a1b-e227-41b4-8fc3-0171ef910df7 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:14.168324 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-645b2a1b-e227-41b4-8fc3-0171ef910df7 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:14.168802 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-645b2a1b-e227-41b4-8fc3-0171ef910df7 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:14.257468 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-163623e4-e400-4ec2-bb2f-688064179fe1 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:14.258119 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-163623e4-e400-4ec2-bb2f-688064179fe1 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:14.267379 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-163623e4-e400-4ec2-bb2f-688064179fe1 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:14.267379 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-163623e4-e400-4ec2-bb2f-688064179fe1 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:14.267379 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-163623e4-e400-4ec2-bb2f-688064179fe1 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:14.267379 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-163623e4-e400-4ec2-bb2f-688064179fe1 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:14.354201 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-163623e4-e400-4ec2-bb2f-688064179fe1 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:14.365481 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-163623e4-e400-4ec2-bb2f-688064179fe1 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1139 microversion: 2.1 time: 0.111819 Aug 03 05:16:14.366509 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 224/413] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:14 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1139 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:16:14.381597 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-25e97b94-7a9a-4e0f-a64c-83c5d682ab27 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:14.382074 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-25e97b94-7a9a-4e0f-a64c-83c5d682ab27 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] [instance: a21965b8-51d4-4bb6-afb7-053298242bfa] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:14.395034 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-25e97b94-7a9a-4e0f-a64c-83c5d682ab27 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:14.398511 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-25e97b94-7a9a-4e0f-a64c-83c5d682ab27 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:14.398511 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-25e97b94-7a9a-4e0f-a64c-83c5d682ab27 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:14.398511 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-25e97b94-7a9a-4e0f-a64c-83c5d682ab27 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:14.419755 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-645b2a1b-e227-41b4-8fc3-0171ef910df7 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:14.430658 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-645b2a1b-e227-41b4-8fc3-0171ef910df7 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:14.432186 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-645b2a1b-e227-41b4-8fc3-0171ef910df7 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:14.433930 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-645b2a1b-e227-41b4-8fc3-0171ef910df7 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1806 microversion: 2.20 time: 0.287373 Aug 03 05:16:14.434495 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 190/414] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:16:14 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1806 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:16:14.470176 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-b92ddd29-bbab-45f7-8ce0-cd3b7e89a53c tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:14.475405 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-b92ddd29-bbab-45f7-8ce0-cd3b7e89a53c tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] [instance: 363118dd-a0c3-444f-99cb-f0578407e0d2] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:14.485849 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b92ddd29-bbab-45f7-8ce0-cd3b7e89a53c tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:14.486301 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b92ddd29-bbab-45f7-8ce0-cd3b7e89a53c tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:14.487114 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b92ddd29-bbab-45f7-8ce0-cd3b7e89a53c tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:14.487625 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b92ddd29-bbab-45f7-8ce0-cd3b7e89a53c tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:14.553268 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-25e97b94-7a9a-4e0f-a64c-83c5d682ab27 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff504c0570b24f3baa8744a9740bcfce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a970d4cbb3545a187c75848e10cb166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:14.571962 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-25e97b94-7a9a-4e0f-a64c-83c5d682ab27 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] 10.222.0.40 "GET /compute/v2.1/servers/a21965b8-51d4-4bb6-afb7-053298242bfa" status: 200 len: 1218 microversion: 2.1 time: 0.194101 Aug 03 05:16:14.572756 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 225/415] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:14 2022] GET /compute/v2.1/servers/a21965b8-51d4-4bb6-afb7-053298242bfa => generated 1218 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:14.591947 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-ab371ed9-3c74-4e1a-bccf-1e81b1ca231a tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:14.592759 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-ab371ed9-3c74-4e1a-bccf-1e81b1ca231a tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] [instance: fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:14.610542 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ab371ed9-3c74-4e1a-bccf-1e81b1ca231a tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:14.610542 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ab371ed9-3c74-4e1a-bccf-1e81b1ca231a tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:14.610542 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ab371ed9-3c74-4e1a-bccf-1e81b1ca231a tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:14.610542 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ab371ed9-3c74-4e1a-bccf-1e81b1ca231a tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:14.738067 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-ab371ed9-3c74-4e1a-bccf-1e81b1ca231a tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7d91983dc4c0fb218e7bdbc1c6558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6675985e19c44dabb624420aaa97b0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:14.748731 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-ab371ed9-3c74-4e1a-bccf-1e81b1ca231a tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] 10.222.0.40 "GET /compute/v2.1/servers/fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5" status: 200 len: 1223 microversion: 2.1 time: 0.172623 Aug 03 05:16:14.749503 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 226/416] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:14 2022] GET /compute/v2.1/servers/fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5 => generated 1223 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:14.803478 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-b92ddd29-bbab-45f7-8ce0-cd3b7e89a53c tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79539af2999d48baa11734ced32dccb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d7bf6baa2224b0d910133c5542608e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:14.817768 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-b92ddd29-bbab-45f7-8ce0-cd3b7e89a53c tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2" status: 200 len: 1358 microversion: 2.1 time: 0.351379 Aug 03 05:16:14.831163 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 191/417] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:14 2022] GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2 => generated 1358 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:15.392152 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-eed781db-1887-4357-b056-251e46a45a26 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:15.393065 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-eed781db-1887-4357-b056-251e46a45a26 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:15.400011 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-eed781db-1887-4357-b056-251e46a45a26 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:15.400608 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-eed781db-1887-4357-b056-251e46a45a26 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:15.401525 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-eed781db-1887-4357-b056-251e46a45a26 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:15.402232 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-eed781db-1887-4357-b056-251e46a45a26 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:15.461725 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-e9be5183-79e5-41e8-8a42-ae834346f011 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:15.462358 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-e9be5183-79e5-41e8-8a42-ae834346f011 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:15.468286 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-eed781db-1887-4357-b056-251e46a45a26 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:15.469510 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e9be5183-79e5-41e8-8a42-ae834346f011 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:15.470137 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e9be5183-79e5-41e8-8a42-ae834346f011 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:15.471198 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e9be5183-79e5-41e8-8a42-ae834346f011 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:15.471651 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e9be5183-79e5-41e8-8a42-ae834346f011 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:15.479279 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-eed781db-1887-4357-b056-251e46a45a26 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1131 microversion: 2.1 time: 0.090958 Aug 03 05:16:15.479871 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 227/418] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:15 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1131 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:15.595345 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-180ec0b2-c1c7-4b5d-a838-0615c724f667 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:15.596140 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-180ec0b2-c1c7-4b5d-a838-0615c724f667 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] [instance: a21965b8-51d4-4bb6-afb7-053298242bfa] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:15.598227 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:16:15.603132 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-180ec0b2-c1c7-4b5d-a838-0615c724f667 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:15.603587 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-180ec0b2-c1c7-4b5d-a838-0615c724f667 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:15.604359 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-180ec0b2-c1c7-4b5d-a838-0615c724f667 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:15.604801 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-180ec0b2-c1c7-4b5d-a838-0615c724f667 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:15.609065 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-e9be5183-79e5-41e8-8a42-ae834346f011 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:15.617454 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-e9be5183-79e5-41e8-8a42-ae834346f011 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:15.618967 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-e9be5183-79e5-41e8-8a42-ae834346f011 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:15.620821 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-e9be5183-79e5-41e8-8a42-ae834346f011 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1806 microversion: 2.20 time: 0.162502 Aug 03 05:16:15.621444 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 192/419] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:16:15 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1806 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 05:16:15.669780 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-180ec0b2-c1c7-4b5d-a838-0615c724f667 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff504c0570b24f3baa8744a9740bcfce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a970d4cbb3545a187c75848e10cb166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:15.678082 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-180ec0b2-c1c7-4b5d-a838-0615c724f667 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] 10.222.0.40 "GET /compute/v2.1/servers/a21965b8-51d4-4bb6-afb7-053298242bfa" status: 200 len: 1210 microversion: 2.1 time: 0.087013 Aug 03 05:16:15.678685 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 228/420] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:15 2022] GET /compute/v2.1/servers/a21965b8-51d4-4bb6-afb7-053298242bfa => generated 1210 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:16:15.770418 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-b35e9a5b-533e-484d-95e0-c252d96f4530 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:15.771059 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-b35e9a5b-533e-484d-95e0-c252d96f4530 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] [instance: fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:15.777620 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b35e9a5b-533e-484d-95e0-c252d96f4530 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:15.778145 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b35e9a5b-533e-484d-95e0-c252d96f4530 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:15.778830 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b35e9a5b-533e-484d-95e0-c252d96f4530 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:15.779291 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b35e9a5b-533e-484d-95e0-c252d96f4530 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:15.840159 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-b35e9a5b-533e-484d-95e0-c252d96f4530 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7d91983dc4c0fb218e7bdbc1c6558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6675985e19c44dabb624420aaa97b0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:15.843553 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-b68d8737-3b87-4d2e-bc54-1793ac56c888 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:15.844163 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-b68d8737-3b87-4d2e-bc54-1793ac56c888 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] [instance: 363118dd-a0c3-444f-99cb-f0578407e0d2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:15.847981 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-b35e9a5b-533e-484d-95e0-c252d96f4530 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] 10.222.0.40 "GET /compute/v2.1/servers/fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5" status: 200 len: 1215 microversion: 2.1 time: 0.081433 Aug 03 05:16:15.848551 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 193/421] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:15 2022] GET /compute/v2.1/servers/fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5 => generated 1215 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:15.850170 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b68d8737-3b87-4d2e-bc54-1793ac56c888 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:15.850621 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b68d8737-3b87-4d2e-bc54-1793ac56c888 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:15.851405 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b68d8737-3b87-4d2e-bc54-1793ac56c888 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:15.851839 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b68d8737-3b87-4d2e-bc54-1793ac56c888 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:15.980294 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-b68d8737-3b87-4d2e-bc54-1793ac56c888 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79539af2999d48baa11734ced32dccb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d7bf6baa2224b0d910133c5542608e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:15.987895 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-b68d8737-3b87-4d2e-bc54-1793ac56c888 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2" status: 200 len: 1358 microversion: 2.1 time: 0.149522 Aug 03 05:16:15.988472 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 229/422] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:15 2022] GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:16:16.501113 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-7d9f9a20-8647-44a1-be37-8e35e7a920b6 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:16.501731 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-7d9f9a20-8647-44a1-be37-8e35e7a920b6 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:16.507864 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-7d9f9a20-8647-44a1-be37-8e35e7a920b6 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:16.512533 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-7d9f9a20-8647-44a1-be37-8e35e7a920b6 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:16.512533 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-7d9f9a20-8647-44a1-be37-8e35e7a920b6 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:16.512533 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-7d9f9a20-8647-44a1-be37-8e35e7a920b6 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:16.575929 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-7d9f9a20-8647-44a1-be37-8e35e7a920b6 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:16.583364 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-7d9f9a20-8647-44a1-be37-8e35e7a920b6 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1131 microversion: 2.1 time: 0.086259 Aug 03 05:16:16.583934 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 194/423] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:16 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1131 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:16.644831 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-5ce07256-9115-4657-8baa-209287ffa8e5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:16.645940 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-5ce07256-9115-4657-8baa-209287ffa8e5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:16.653289 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5ce07256-9115-4657-8baa-209287ffa8e5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:16.653289 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5ce07256-9115-4657-8baa-209287ffa8e5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:16.655940 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5ce07256-9115-4657-8baa-209287ffa8e5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:16.655940 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5ce07256-9115-4657-8baa-209287ffa8e5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:16.702654 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-dba8c309-65f1-4368-8a8d-0ba14a1a69af tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:16.704400 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-dba8c309-65f1-4368-8a8d-0ba14a1a69af tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] [instance: a21965b8-51d4-4bb6-afb7-053298242bfa] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:16.710245 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-dba8c309-65f1-4368-8a8d-0ba14a1a69af tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:16.710701 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-dba8c309-65f1-4368-8a8d-0ba14a1a69af tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:16.711530 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-dba8c309-65f1-4368-8a8d-0ba14a1a69af tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:16.712023 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-dba8c309-65f1-4368-8a8d-0ba14a1a69af tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:16.793264 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-dba8c309-65f1-4368-8a8d-0ba14a1a69af tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff504c0570b24f3baa8744a9740bcfce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a970d4cbb3545a187c75848e10cb166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:16.800607 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-dba8c309-65f1-4368-8a8d-0ba14a1a69af tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] 10.222.0.40 "GET /compute/v2.1/servers/a21965b8-51d4-4bb6-afb7-053298242bfa" status: 200 len: 1266 microversion: 2.1 time: 0.101890 Aug 03 05:16:16.801186 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 195/424] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:16 2022] GET /compute/v2.1/servers/a21965b8-51d4-4bb6-afb7-053298242bfa => generated 1266 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:16:16.810161 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-5ce07256-9115-4657-8baa-209287ffa8e5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:16.818459 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-5ce07256-9115-4657-8baa-209287ffa8e5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:16.820066 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-5ce07256-9115-4657-8baa-209287ffa8e5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:16.821215 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-5ce07256-9115-4657-8baa-209287ffa8e5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1806 microversion: 2.20 time: 0.180325 Aug 03 05:16:16.821768 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 230/425] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:16:16 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1806 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:16:16.870359 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-67117d10-775f-4d3f-af74-a85c71641494 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:16.871029 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-67117d10-775f-4d3f-af74-a85c71641494 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] [instance: fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:16.877502 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-67117d10-775f-4d3f-af74-a85c71641494 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:16.878108 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-67117d10-775f-4d3f-af74-a85c71641494 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:16.878915 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-67117d10-775f-4d3f-af74-a85c71641494 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:16.879355 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-67117d10-775f-4d3f-af74-a85c71641494 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:16.944836 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-67117d10-775f-4d3f-af74-a85c71641494 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7d91983dc4c0fb218e7bdbc1c6558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6675985e19c44dabb624420aaa97b0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:16.952308 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-67117d10-775f-4d3f-af74-a85c71641494 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] 10.222.0.40 "GET /compute/v2.1/servers/fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5" status: 200 len: 1271 microversion: 2.1 time: 0.086358 Aug 03 05:16:16.952893 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 196/426] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:16 2022] GET /compute/v2.1/servers/fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5 => generated 1271 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:17.008636 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-1a0d7e0f-d1c7-4206-a191-51fa84a7fd62 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:17.009250 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-1a0d7e0f-d1c7-4206-a191-51fa84a7fd62 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] [instance: 363118dd-a0c3-444f-99cb-f0578407e0d2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:17.017311 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1a0d7e0f-d1c7-4206-a191-51fa84a7fd62 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:17.017774 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1a0d7e0f-d1c7-4206-a191-51fa84a7fd62 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:17.018806 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1a0d7e0f-d1c7-4206-a191-51fa84a7fd62 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:17.019286 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1a0d7e0f-d1c7-4206-a191-51fa84a7fd62 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:17.152888 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-1a0d7e0f-d1c7-4206-a191-51fa84a7fd62 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79539af2999d48baa11734ced32dccb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d7bf6baa2224b0d910133c5542608e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:17.160614 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-1a0d7e0f-d1c7-4206-a191-51fa84a7fd62 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2" status: 200 len: 1358 microversion: 2.1 time: 0.155898 Aug 03 05:16:17.161215 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 231/427] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:17 2022] GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:17.604614 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-828cb95c-f8b4-49d9-9b3e-fc20315401bd tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:17.605148 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-828cb95c-f8b4-49d9-9b3e-fc20315401bd tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:17.611099 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-828cb95c-f8b4-49d9-9b3e-fc20315401bd tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:17.611541 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-828cb95c-f8b4-49d9-9b3e-fc20315401bd tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:17.612289 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-828cb95c-f8b4-49d9-9b3e-fc20315401bd tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:17.612716 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-828cb95c-f8b4-49d9-9b3e-fc20315401bd tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:17.676114 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-828cb95c-f8b4-49d9-9b3e-fc20315401bd tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:17.684112 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-828cb95c-f8b4-49d9-9b3e-fc20315401bd tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1187 microversion: 2.1 time: 0.083460 Aug 03 05:16:17.684677 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 197/428] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:17 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1187 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:17.821390 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-5c738c6e-7ba9-4301-9dd2-7a23f8782405 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:17.822059 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-5c738c6e-7ba9-4301-9dd2-7a23f8782405 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] [instance: a21965b8-51d4-4bb6-afb7-053298242bfa] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:17.829660 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5c738c6e-7ba9-4301-9dd2-7a23f8782405 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:17.830115 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5c738c6e-7ba9-4301-9dd2-7a23f8782405 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:17.830905 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5c738c6e-7ba9-4301-9dd2-7a23f8782405 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:17.831352 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5c738c6e-7ba9-4301-9dd2-7a23f8782405 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:17.845407 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-2c3c0526-cff0-4e12-a36a-25032bec5e4a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:17.846010 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-2c3c0526-cff0-4e12-a36a-25032bec5e4a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:17.851894 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-2c3c0526-cff0-4e12-a36a-25032bec5e4a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:17.852351 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-2c3c0526-cff0-4e12-a36a-25032bec5e4a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:17.853114 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-2c3c0526-cff0-4e12-a36a-25032bec5e4a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:17.853547 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-2c3c0526-cff0-4e12-a36a-25032bec5e4a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:17.895177 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-5c738c6e-7ba9-4301-9dd2-7a23f8782405 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff504c0570b24f3baa8744a9740bcfce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a970d4cbb3545a187c75848e10cb166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:17.902705 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-5c738c6e-7ba9-4301-9dd2-7a23f8782405 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] 10.222.0.40 "GET /compute/v2.1/servers/a21965b8-51d4-4bb6-afb7-053298242bfa" status: 200 len: 1266 microversion: 2.1 time: 0.085087 Aug 03 05:16:17.903313 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 232/429] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:17 2022] GET /compute/v2.1/servers/a21965b8-51d4-4bb6-afb7-053298242bfa => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:17.974513 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-9e9cb7f3-bbcb-49d5-9d47-78015c33215e tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:17.975314 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-9e9cb7f3-bbcb-49d5-9d47-78015c33215e tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] [instance: fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:17.982650 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9e9cb7f3-bbcb-49d5-9d47-78015c33215e tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:17.983210 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9e9cb7f3-bbcb-49d5-9d47-78015c33215e tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:17.984049 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9e9cb7f3-bbcb-49d5-9d47-78015c33215e tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:17.984558 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9e9cb7f3-bbcb-49d5-9d47-78015c33215e tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:17.988873 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:16:18.008457 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-2c3c0526-cff0-4e12-a36a-25032bec5e4a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:18.009933 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-2c3c0526-cff0-4e12-a36a-25032bec5e4a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:18.012284 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-2c3c0526-cff0-4e12-a36a-25032bec5e4a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:18.013454 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-2c3c0526-cff0-4e12-a36a-25032bec5e4a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1806 microversion: 2.20 time: 0.172353 Aug 03 05:16:18.014344 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 198/430] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:16:17 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1806 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 05:16:18.049069 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-9e9cb7f3-bbcb-49d5-9d47-78015c33215e tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7d91983dc4c0fb218e7bdbc1c6558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6675985e19c44dabb624420aaa97b0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:18.056268 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-9e9cb7f3-bbcb-49d5-9d47-78015c33215e tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] 10.222.0.40 "GET /compute/v2.1/servers/fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5" status: 200 len: 1271 microversion: 2.1 time: 0.085609 Aug 03 05:16:18.056830 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 233/431] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:17 2022] GET /compute/v2.1/servers/fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5 => generated 1271 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:16:18.182040 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-471f2abc-6d40-445d-933f-13af40a58efc tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:18.182566 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-471f2abc-6d40-445d-933f-13af40a58efc tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] [instance: 363118dd-a0c3-444f-99cb-f0578407e0d2] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:18.188602 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-471f2abc-6d40-445d-933f-13af40a58efc tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:18.189046 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-471f2abc-6d40-445d-933f-13af40a58efc tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:18.189799 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-471f2abc-6d40-445d-933f-13af40a58efc tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:18.190229 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-471f2abc-6d40-445d-933f-13af40a58efc tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:18.319249 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-471f2abc-6d40-445d-933f-13af40a58efc tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79539af2999d48baa11734ced32dccb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d7bf6baa2224b0d910133c5542608e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:18.327240 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-471f2abc-6d40-445d-933f-13af40a58efc tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2" status: 200 len: 1358 microversion: 2.1 time: 0.149113 Aug 03 05:16:18.327803 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 199/432] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:18 2022] GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:18.705883 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-684e9bc3-4ba7-4af7-a7d8-c72540acf940 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:18.706422 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-684e9bc3-4ba7-4af7-a7d8-c72540acf940 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:18.713190 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-684e9bc3-4ba7-4af7-a7d8-c72540acf940 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:18.713810 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-684e9bc3-4ba7-4af7-a7d8-c72540acf940 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:18.717606 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-684e9bc3-4ba7-4af7-a7d8-c72540acf940 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:18.718099 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-684e9bc3-4ba7-4af7-a7d8-c72540acf940 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:18.863263 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-684e9bc3-4ba7-4af7-a7d8-c72540acf940 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:18.881865 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-684e9bc3-4ba7-4af7-a7d8-c72540acf940 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1195 microversion: 2.1 time: 0.177564 Aug 03 05:16:18.882608 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 234/433] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:18 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1195 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:16:18.924081 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-cbdd1444-fecd-4e32-8229-61e0153f0cf5 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:18.925268 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-cbdd1444-fecd-4e32-8229-61e0153f0cf5 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] [instance: a21965b8-51d4-4bb6-afb7-053298242bfa] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:18.932369 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-cbdd1444-fecd-4e32-8229-61e0153f0cf5 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:18.933531 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-cbdd1444-fecd-4e32-8229-61e0153f0cf5 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:18.934280 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-cbdd1444-fecd-4e32-8229-61e0153f0cf5 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:18.934718 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-cbdd1444-fecd-4e32-8229-61e0153f0cf5 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:18.939166 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_cell1:SELECT=100 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:16:19.038778 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-9bfdbbb8-fe52-448b-9683-d1c84e30c386 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:19.039322 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-9bfdbbb8-fe52-448b-9683-d1c84e30c386 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:19.046374 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9bfdbbb8-fe52-448b-9683-d1c84e30c386 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:19.046863 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9bfdbbb8-fe52-448b-9683-d1c84e30c386 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:19.047659 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9bfdbbb8-fe52-448b-9683-d1c84e30c386 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:19.048108 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9bfdbbb8-fe52-448b-9683-d1c84e30c386 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:19.335357 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-cbdd1444-fecd-4e32-8229-61e0153f0cf5 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff504c0570b24f3baa8744a9740bcfce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a970d4cbb3545a187c75848e10cb166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:19.347701 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-cbdd1444-fecd-4e32-8229-61e0153f0cf5 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] 10.222.0.40 "GET /compute/v2.1/servers/a21965b8-51d4-4bb6-afb7-053298242bfa" status: 200 len: 1274 microversion: 2.1 time: 0.427425 Aug 03 05:16:19.348787 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 200/434] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:18 2022] GET /compute/v2.1/servers/a21965b8-51d4-4bb6-afb7-053298242bfa => generated 1274 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:19.355077 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-e3f4efb8-69c7-4344-ae5a-78227a2f5e59 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:19.355874 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-e3f4efb8-69c7-4344-ae5a-78227a2f5e59 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] [instance: fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:19.364681 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e3f4efb8-69c7-4344-ae5a-78227a2f5e59 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:19.365130 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e3f4efb8-69c7-4344-ae5a-78227a2f5e59 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:19.365906 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e3f4efb8-69c7-4344-ae5a-78227a2f5e59 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:19.366339 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e3f4efb8-69c7-4344-ae5a-78227a2f5e59 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:19.501075 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-e3f4efb8-69c7-4344-ae5a-78227a2f5e59 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7d91983dc4c0fb218e7bdbc1c6558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6675985e19c44dabb624420aaa97b0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:19.509817 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-e3f4efb8-69c7-4344-ae5a-78227a2f5e59 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] 10.222.0.40 "GET /compute/v2.1/servers/fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5" status: 200 len: 1277 microversion: 2.1 time: 0.159739 Aug 03 05:16:19.511286 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 201/435] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:19 2022] GET /compute/v2.1/servers/fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5 => generated 1277 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:19.530526 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-3cb00ade-f465-43dc-99e5-3d9dd2fc1275 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:19.531604 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-3cb00ade-f465-43dc-99e5-3d9dd2fc1275 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] [instance: 363118dd-a0c3-444f-99cb-f0578407e0d2] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:19.538396 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3cb00ade-f465-43dc-99e5-3d9dd2fc1275 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:19.539240 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3cb00ade-f465-43dc-99e5-3d9dd2fc1275 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:19.540235 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3cb00ade-f465-43dc-99e5-3d9dd2fc1275 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:19.540899 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3cb00ade-f465-43dc-99e5-3d9dd2fc1275 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:19.645132 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-9bfdbbb8-fe52-448b-9683-d1c84e30c386 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:19.660591 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-9bfdbbb8-fe52-448b-9683-d1c84e30c386 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:19.664436 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-9bfdbbb8-fe52-448b-9683-d1c84e30c386 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:19.667644 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-9bfdbbb8-fe52-448b-9683-d1c84e30c386 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1806 microversion: 2.20 time: 0.632385 Aug 03 05:16:19.669516 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 235/436] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:16:19 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1806 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:16:19.676479 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-3afc7749-0e8f-4749-97f8-12bdfd49d5a6 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:16:19.683407 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3afc7749-0e8f-4749-97f8-12bdfd49d5a6 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:19.684065 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3afc7749-0e8f-4749-97f8-12bdfd49d5a6 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:19.710412 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-3afc7749-0e8f-4749-97f8-12bdfd49d5a6 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Going to try to stop instance {{(pid=118331) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 03 05:16:19.818004 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-3cb00ade-f465-43dc-99e5-3d9dd2fc1275 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79539af2999d48baa11734ced32dccb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d7bf6baa2224b0d910133c5542608e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:19.827302 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-3cb00ade-f465-43dc-99e5-3d9dd2fc1275 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2" status: 200 len: 1358 microversion: 2.1 time: 0.302638 Aug 03 05:16:19.828728 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 202/437] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:19 2022] GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2 => generated 1358 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:19.904982 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-e6855874-6d15-45e0-a1f5-5ea30209c6bc tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:19.905594 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-e6855874-6d15-45e0-a1f5-5ea30209c6bc tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:19.924864 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e6855874-6d15-45e0-a1f5-5ea30209c6bc tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:19.925407 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e6855874-6d15-45e0-a1f5-5ea30209c6bc tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:19.926092 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e6855874-6d15-45e0-a1f5-5ea30209c6bc tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:19.926532 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e6855874-6d15-45e0-a1f5-5ea30209c6bc tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:19.951126 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-3afc7749-0e8f-4749-97f8-12bdfd49d5a6 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "POST /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5/action" status: 202 len: 0 microversion: 2.1 time: 0.279916 Aug 03 05:16:19.955651 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 236/438] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Aug 3 05:16:19 2022] POST /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:16:20.000178 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-8596fa54-6b5b-48a7-b5aa-99ad6ae718b3 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:20.000753 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-8596fa54-6b5b-48a7-b5aa-99ad6ae718b3 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:20.024612 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8596fa54-6b5b-48a7-b5aa-99ad6ae718b3 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:20.026614 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8596fa54-6b5b-48a7-b5aa-99ad6ae718b3 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:20.027464 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8596fa54-6b5b-48a7-b5aa-99ad6ae718b3 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:20.031380 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8596fa54-6b5b-48a7-b5aa-99ad6ae718b3 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:20.206072 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_cell0:SELECT=2 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:16:20.362039 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-e6855874-6d15-45e0-a1f5-5ea30209c6bc tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:20.377416 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-e6855874-6d15-45e0-a1f5-5ea30209c6bc tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1272 microversion: 2.1 time: 0.475909 Aug 03 05:16:20.380804 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 203/439] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:19 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1272 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:20.388217 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-ace7fc1a-d4df-41a1-aed9-678df63fd21d tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:20.388834 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-ace7fc1a-d4df-41a1-aed9-678df63fd21d tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] [instance: a21965b8-51d4-4bb6-afb7-053298242bfa] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:20.398479 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-ace7fc1a-d4df-41a1-aed9-678df63fd21d tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:20.416159 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-ace7fc1a-d4df-41a1-aed9-678df63fd21d tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:20.418122 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-ace7fc1a-d4df-41a1-aed9-678df63fd21d tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:20.420156 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-ace7fc1a-d4df-41a1-aed9-678df63fd21d tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:20.441165 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell0:SELECT=4 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:16:20.522823 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-8596fa54-6b5b-48a7-b5aa-99ad6ae718b3 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:20.538195 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-8596fa54-6b5b-48a7-b5aa-99ad6ae718b3 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5" status: 200 len: 1677 microversion: 2.1 time: 0.546681 Aug 03 05:16:20.539145 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 237/440] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:19 2022] GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 => generated 1677 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:20.551449 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-ace7fc1a-d4df-41a1-aed9-678df63fd21d tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff504c0570b24f3baa8744a9740bcfce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a970d4cbb3545a187c75848e10cb166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:20.560094 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-ebd75f2f-f6af-43a4-9b56-a856b4ca9276 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:20.561741 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-ebd75f2f-f6af-43a4-9b56-a856b4ca9276 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] [instance: fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:20.563362 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-ace7fc1a-d4df-41a1-aed9-678df63fd21d tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] 10.222.0.40 "GET /compute/v2.1/servers/a21965b8-51d4-4bb6-afb7-053298242bfa" status: 200 len: 1272 microversion: 2.1 time: 0.183073 Aug 03 05:16:20.563949 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 204/441] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:20 2022] GET /compute/v2.1/servers/a21965b8-51d4-4bb6-afb7-053298242bfa => generated 1272 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:20.568994 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ebd75f2f-f6af-43a4-9b56-a856b4ca9276 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:20.570198 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ebd75f2f-f6af-43a4-9b56-a856b4ca9276 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:20.571147 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ebd75f2f-f6af-43a4-9b56-a856b4ca9276 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:20.571876 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ebd75f2f-f6af-43a4-9b56-a856b4ca9276 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:20.694803 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-80e4d6bd-fd5b-4195-93c1-399384019d36 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:20.698392 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-80e4d6bd-fd5b-4195-93c1-399384019d36 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:20.701893 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-80e4d6bd-fd5b-4195-93c1-399384019d36 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:20.702343 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-80e4d6bd-fd5b-4195-93c1-399384019d36 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:20.703138 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-80e4d6bd-fd5b-4195-93c1-399384019d36 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:20.703573 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-80e4d6bd-fd5b-4195-93c1-399384019d36 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:20.978653 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-ebd75f2f-f6af-43a4-9b56-a856b4ca9276 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7d91983dc4c0fb218e7bdbc1c6558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6675985e19c44dabb624420aaa97b0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:20.986994 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-ebd75f2f-f6af-43a4-9b56-a856b4ca9276 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] 10.222.0.40 "GET /compute/v2.1/servers/fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5" status: 200 len: 1319 microversion: 2.1 time: 0.434047 Aug 03 05:16:20.987565 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 238/442] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:20 2022] GET /compute/v2.1/servers/fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5 => generated 1319 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:20.992004 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-5572767a-af9f-4341-a3c8-fa48f77242b6 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:20.992791 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-5572767a-af9f-4341-a3c8-fa48f77242b6 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] [instance: 363118dd-a0c3-444f-99cb-f0578407e0d2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:20.998952 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5572767a-af9f-4341-a3c8-fa48f77242b6 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:20.999790 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5572767a-af9f-4341-a3c8-fa48f77242b6 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:21.000716 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5572767a-af9f-4341-a3c8-fa48f77242b6 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:21.001323 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5572767a-af9f-4341-a3c8-fa48f77242b6 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:21.021501 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-80e4d6bd-fd5b-4195-93c1-399384019d36 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:21.031988 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-80e4d6bd-fd5b-4195-93c1-399384019d36 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:21.033790 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-80e4d6bd-fd5b-4195-93c1-399384019d36 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:21.035035 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-80e4d6bd-fd5b-4195-93c1-399384019d36 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1806 microversion: 2.20 time: 0.346876 Aug 03 05:16:21.035938 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 205/443] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:16:20 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1806 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 05:16:21.062594 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [req-970481f6-c16c-4ae1-9da5-77ec70734a2b req-87d74f27-cc9d-4c7a-9b7e-74e434d180e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0", "tag": "255ebc2e-922a-4b85-be40-f642cc2ae298"}]} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:16:21.073849 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-970481f6-c16c-4ae1-9da5-77ec70734a2b req-87d74f27-cc9d-4c7a-9b7e-74e434d180e3 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:21.074683 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-970481f6-c16c-4ae1-9da5-77ec70734a2b req-87d74f27-cc9d-4c7a-9b7e-74e434d180e3 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:21.087876 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.compute.server_external_events [req-970481f6-c16c-4ae1-9da5-77ec70734a2b req-87d74f27-cc9d-4c7a-9b7e-74e434d180e3 service nova] Creating event network-changed:255ebc2e-922a-4b85-be40-f642cc2ae298 for instance b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 on hv-cinder-85127 Aug 03 05:16:21.093659 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [req-970481f6-c16c-4ae1-9da5-77ec70734a2b req-87d74f27-cc9d-4c7a-9b7e-74e434d180e3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034752 Aug 03 05:16:21.094810 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 206/444] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:16:21.285975 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-5572767a-af9f-4341-a3c8-fa48f77242b6 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79539af2999d48baa11734ced32dccb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d7bf6baa2224b0d910133c5542608e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:21.295600 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-5572767a-af9f-4341-a3c8-fa48f77242b6 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2" status: 200 len: 1358 microversion: 2.1 time: 0.306963 Aug 03 05:16:21.296521 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 239/445] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:20 2022] GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2 => generated 1358 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:21.404564 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-ee2d5a8c-a675-4bb3-a466-67e2221fdc2f tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:21.405772 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-ee2d5a8c-a675-4bb3-a466-67e2221fdc2f tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:21.424220 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-ee2d5a8c-a675-4bb3-a466-67e2221fdc2f tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:21.424675 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-ee2d5a8c-a675-4bb3-a466-67e2221fdc2f tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:21.425460 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-ee2d5a8c-a675-4bb3-a466-67e2221fdc2f tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:21.426119 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-ee2d5a8c-a675-4bb3-a466-67e2221fdc2f tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:21.564438 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-a7314038-08ac-4947-9119-406023077cae tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:21.565061 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-a7314038-08ac-4947-9119-406023077cae tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:21.574797 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a7314038-08ac-4947-9119-406023077cae tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:21.575503 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a7314038-08ac-4947-9119-406023077cae tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:21.576577 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a7314038-08ac-4947-9119-406023077cae tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:21.577028 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a7314038-08ac-4947-9119-406023077cae tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:21.836639 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-ee2d5a8c-a675-4bb3-a466-67e2221fdc2f tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:21.845840 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-ee2d5a8c-a675-4bb3-a466-67e2221fdc2f tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1260 microversion: 2.1 time: 0.446398 Aug 03 05:16:21.846437 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 207/446] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:21 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1260 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:21.851587 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-cd27e8c6-1a7d-4e4e-b4b8-019fc60dd8b5 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:21.852614 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-cd27e8c6-1a7d-4e4e-b4b8-019fc60dd8b5 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] [instance: a21965b8-51d4-4bb6-afb7-053298242bfa] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:21.859371 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-cd27e8c6-1a7d-4e4e-b4b8-019fc60dd8b5 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:21.869537 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-cd27e8c6-1a7d-4e4e-b4b8-019fc60dd8b5 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:21.871274 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-cd27e8c6-1a7d-4e4e-b4b8-019fc60dd8b5 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:21.871713 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-cd27e8c6-1a7d-4e4e-b4b8-019fc60dd8b5 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:21.987754 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-a7314038-08ac-4947-9119-406023077cae tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:21.996540 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-a7314038-08ac-4947-9119-406023077cae tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5" status: 200 len: 1677 microversion: 2.1 time: 0.435869 Aug 03 05:16:21.997459 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 240/447] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:21 2022] GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 => generated 1677 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:22.009195 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-081e2b7b-d32d-4e89-8c93-2a235573ebbe tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:22.010581 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-081e2b7b-d32d-4e89-8c93-2a235573ebbe tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] [instance: fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:22.017943 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-081e2b7b-d32d-4e89-8c93-2a235573ebbe tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:22.018398 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-081e2b7b-d32d-4e89-8c93-2a235573ebbe tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:22.019225 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-081e2b7b-d32d-4e89-8c93-2a235573ebbe tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:22.025055 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-081e2b7b-d32d-4e89-8c93-2a235573ebbe tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:22.199597 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell0:SELECT=24 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:16:22.221081 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-cd27e8c6-1a7d-4e4e-b4b8-019fc60dd8b5 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff504c0570b24f3baa8744a9740bcfce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a970d4cbb3545a187c75848e10cb166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:22.231146 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-cd27e8c6-1a7d-4e4e-b4b8-019fc60dd8b5 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] 10.222.0.40 "GET /compute/v2.1/servers/a21965b8-51d4-4bb6-afb7-053298242bfa" status: 200 len: 1314 microversion: 2.1 time: 0.382300 Aug 03 05:16:22.236079 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 208/448] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:21 2022] GET /compute/v2.1/servers/a21965b8-51d4-4bb6-afb7-053298242bfa => generated 1314 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:22.245203 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [req-ad096260-4a37-4812-8ddb-e9e8b5f682f4 req-5f96f029-bc06-48ad-a305-64079a0ada2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "363118dd-a0c3-444f-99cb-f0578407e0d2", "name": "network-vif-plugged", "status": "completed", "tag": "1d2d095e-7779-4335-a8cf-cbd4d15b643b"}]} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:16:22.254877 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-ad096260-4a37-4812-8ddb-e9e8b5f682f4 req-5f96f029-bc06-48ad-a305-64079a0ada2e service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:22.255427 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-ad096260-4a37-4812-8ddb-e9e8b5f682f4 req-5f96f029-bc06-48ad-a305-64079a0ada2e service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:22.259265 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_cell0:SELECT=10 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:16:22.266815 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.compute.server_external_events [req-ad096260-4a37-4812-8ddb-e9e8b5f682f4 req-5f96f029-bc06-48ad-a305-64079a0ada2e service nova] Creating event network-vif-plugged:1d2d095e-7779-4335-a8cf-cbd4d15b643b for instance 363118dd-a0c3-444f-99cb-f0578407e0d2 on hv-cinder-85127 Aug 03 05:16:22.271721 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [req-ad096260-4a37-4812-8ddb-e9e8b5f682f4 req-5f96f029-bc06-48ad-a305-64079a0ada2e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030357 Aug 03 05:16:22.272299 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 209/449] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:16:22.277895 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-43a521d7-b0db-4edd-8c00-cd04c07667b7 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:22.278585 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-43a521d7-b0db-4edd-8c00-cd04c07667b7 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:22.284777 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-43a521d7-b0db-4edd-8c00-cd04c07667b7 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:22.285232 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-43a521d7-b0db-4edd-8c00-cd04c07667b7 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:22.286000 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-43a521d7-b0db-4edd-8c00-cd04c07667b7 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:22.286438 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-43a521d7-b0db-4edd-8c00-cd04c07667b7 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:22.379382 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-081e2b7b-d32d-4e89-8c93-2a235573ebbe tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7d91983dc4c0fb218e7bdbc1c6558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6675985e19c44dabb624420aaa97b0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:22.386856 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-081e2b7b-d32d-4e89-8c93-2a235573ebbe tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] 10.222.0.40 "GET /compute/v2.1/servers/fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5" status: 200 len: 1319 microversion: 2.1 time: 0.382536 Aug 03 05:16:22.387438 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 241/450] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:22 2022] GET /compute/v2.1/servers/fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5 => generated 1319 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:22.392048 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-d8f17d53-f873-4516-a659-203b9d68485a tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:22.392655 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-d8f17d53-f873-4516-a659-203b9d68485a tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] [instance: 363118dd-a0c3-444f-99cb-f0578407e0d2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:22.399566 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d8f17d53-f873-4516-a659-203b9d68485a tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:22.400028 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d8f17d53-f873-4516-a659-203b9d68485a tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:22.402244 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d8f17d53-f873-4516-a659-203b9d68485a tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:22.402703 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d8f17d53-f873-4516-a659-203b9d68485a tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:22.631342 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-43a521d7-b0db-4edd-8c00-cd04c07667b7 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:22.640668 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-43a521d7-b0db-4edd-8c00-cd04c07667b7 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:22.642195 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-43a521d7-b0db-4edd-8c00-cd04c07667b7 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:22.643419 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-43a521d7-b0db-4edd-8c00-cd04c07667b7 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1806 microversion: 2.20 time: 0.370053 Aug 03 05:16:22.644246 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 210/451] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:16:22 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1806 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:16:22.868479 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-ca1c4b4f-4482-4bdf-9451-7e40d61ccf00 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:22.869206 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-ca1c4b4f-4482-4bdf-9451-7e40d61ccf00 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:22.875919 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-ca1c4b4f-4482-4bdf-9451-7e40d61ccf00 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:22.876372 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-ca1c4b4f-4482-4bdf-9451-7e40d61ccf00 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:22.877161 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-ca1c4b4f-4482-4bdf-9451-7e40d61ccf00 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:22.877604 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-ca1c4b4f-4482-4bdf-9451-7e40d61ccf00 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:23.023509 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-d8f17d53-f873-4516-a659-203b9d68485a tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79539af2999d48baa11734ced32dccb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d7bf6baa2224b0d910133c5542608e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:23.031158 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-d8f17d53-f873-4516-a659-203b9d68485a tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2" status: 200 len: 1358 microversion: 2.1 time: 0.642649 Aug 03 05:16:23.031743 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 242/452] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:22 2022] GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2 => generated 1358 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:23.036387 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-6f51b7da-6170-44bc-9622-3413ac0e13db tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:23.037193 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-6f51b7da-6170-44bc-9622-3413ac0e13db tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:23.042980 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6f51b7da-6170-44bc-9622-3413ac0e13db tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:23.043443 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6f51b7da-6170-44bc-9622-3413ac0e13db tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:23.044259 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6f51b7da-6170-44bc-9622-3413ac0e13db tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:23.045025 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6f51b7da-6170-44bc-9622-3413ac0e13db tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:23.193734 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-ca1c4b4f-4482-4bdf-9451-7e40d61ccf00 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:23.202615 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-ca1c4b4f-4482-4bdf-9451-7e40d61ccf00 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1260 microversion: 2.1 time: 0.337961 Aug 03 05:16:23.203274 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 211/453] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:22 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1260 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:23.207730 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [req-04af6322-0458-4f28-a4df-a360a450a396 req-8e403fee-a81b-402b-9685-caeba30e335f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5", "tag": "97f8fdc6-81d2-4bf6-91c7-f43776182afd"}]} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:16:23.218303 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-04af6322-0458-4f28-a4df-a360a450a396 req-8e403fee-a81b-402b-9685-caeba30e335f service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:23.218753 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-04af6322-0458-4f28-a4df-a360a450a396 req-8e403fee-a81b-402b-9685-caeba30e335f service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:23.230569 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.compute.server_external_events [req-04af6322-0458-4f28-a4df-a360a450a396 req-8e403fee-a81b-402b-9685-caeba30e335f service nova] Creating event network-changed:97f8fdc6-81d2-4bf6-91c7-f43776182afd for instance fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5 on hv-cinder-85127 Aug 03 05:16:23.235872 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [req-04af6322-0458-4f28-a4df-a360a450a396 req-8e403fee-a81b-402b-9685-caeba30e335f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031444 Aug 03 05:16:23.239525 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 212/454] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:16:23.253960 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-e2185605-8dd0-4844-ad11-a33589967331 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:23.254661 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-e2185605-8dd0-4844-ad11-a33589967331 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] [instance: a21965b8-51d4-4bb6-afb7-053298242bfa] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:23.261700 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e2185605-8dd0-4844-ad11-a33589967331 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:23.265128 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e2185605-8dd0-4844-ad11-a33589967331 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:23.265128 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e2185605-8dd0-4844-ad11-a33589967331 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:23.265128 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e2185605-8dd0-4844-ad11-a33589967331 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:23.328682 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-6f51b7da-6170-44bc-9622-3413ac0e13db tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:23.336609 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-6f51b7da-6170-44bc-9622-3413ac0e13db tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5" status: 200 len: 1677 microversion: 2.1 time: 0.303767 Aug 03 05:16:23.337178 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 243/455] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:23 2022] GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 => generated 1677 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:23.407825 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-9b40afa8-7aea-4217-8da9-6f246c2ee486 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:23.408440 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-9b40afa8-7aea-4217-8da9-6f246c2ee486 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] [instance: fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:23.414720 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9b40afa8-7aea-4217-8da9-6f246c2ee486 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:23.415212 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9b40afa8-7aea-4217-8da9-6f246c2ee486 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:23.415998 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9b40afa8-7aea-4217-8da9-6f246c2ee486 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:23.416937 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9b40afa8-7aea-4217-8da9-6f246c2ee486 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:23.429155 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-e2185605-8dd0-4844-ad11-a33589967331 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff504c0570b24f3baa8744a9740bcfce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a970d4cbb3545a187c75848e10cb166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:23.438253 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-e2185605-8dd0-4844-ad11-a33589967331 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] 10.222.0.40 "GET /compute/v2.1/servers/a21965b8-51d4-4bb6-afb7-053298242bfa" status: 200 len: 1314 microversion: 2.1 time: 0.189499 Aug 03 05:16:23.438986 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 213/456] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:23 2022] GET /compute/v2.1/servers/a21965b8-51d4-4bb6-afb7-053298242bfa => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:23.592433 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-9b40afa8-7aea-4217-8da9-6f246c2ee486 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7d91983dc4c0fb218e7bdbc1c6558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6675985e19c44dabb624420aaa97b0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:23.599868 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-9b40afa8-7aea-4217-8da9-6f246c2ee486 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] 10.222.0.40 "GET /compute/v2.1/servers/fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5" status: 200 len: 1319 microversion: 2.1 time: 0.195982 Aug 03 05:16:23.600436 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 244/457] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:23 2022] GET /compute/v2.1/servers/fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5 => generated 1319 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:16:23.668263 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-358b638d-5441-4832-a06a-068788786b0a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:23.668866 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-358b638d-5441-4832-a06a-068788786b0a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:23.674863 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-358b638d-5441-4832-a06a-068788786b0a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:23.675308 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-358b638d-5441-4832-a06a-068788786b0a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:23.676060 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-358b638d-5441-4832-a06a-068788786b0a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:23.676487 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-358b638d-5441-4832-a06a-068788786b0a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:23.944277 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-358b638d-5441-4832-a06a-068788786b0a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:23.954478 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-358b638d-5441-4832-a06a-068788786b0a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:23.955880 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-358b638d-5441-4832-a06a-068788786b0a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:23.957119 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-358b638d-5441-4832-a06a-068788786b0a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1806 microversion: 2.20 time: 0.294015 Aug 03 05:16:23.967513 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 214/458] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:16:23 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1806 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:16:24.052080 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-965dc31f-843d-40b2-945b-cde30c371108 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:24.052695 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-965dc31f-843d-40b2-945b-cde30c371108 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] [instance: 363118dd-a0c3-444f-99cb-f0578407e0d2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:24.059926 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-965dc31f-843d-40b2-945b-cde30c371108 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:24.060527 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-965dc31f-843d-40b2-945b-cde30c371108 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:24.065229 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-965dc31f-843d-40b2-945b-cde30c371108 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:24.065229 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-965dc31f-843d-40b2-945b-cde30c371108 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:24.223942 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-ba872db8-4098-4ea3-8f56-fd4f00bd08d0 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:24.224560 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-ba872db8-4098-4ea3-8f56-fd4f00bd08d0 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:24.230749 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-ba872db8-4098-4ea3-8f56-fd4f00bd08d0 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:24.231349 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-ba872db8-4098-4ea3-8f56-fd4f00bd08d0 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:24.232000 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-ba872db8-4098-4ea3-8f56-fd4f00bd08d0 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:24.232442 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-ba872db8-4098-4ea3-8f56-fd4f00bd08d0 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:24.259392 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-965dc31f-843d-40b2-945b-cde30c371108 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79539af2999d48baa11734ced32dccb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d7bf6baa2224b0d910133c5542608e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:24.267926 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-965dc31f-843d-40b2-945b-cde30c371108 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2" status: 200 len: 1358 microversion: 2.1 time: 0.219761 Aug 03 05:16:24.268511 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 245/459] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:24 2022] GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2 => generated 1358 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:24.357706 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-3b64f4d8-617e-4ff9-870c-6ca5163d760a tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:24.362776 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-3b64f4d8-617e-4ff9-870c-6ca5163d760a tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:24.363123 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-ba872db8-4098-4ea3-8f56-fd4f00bd08d0 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:24.371063 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3b64f4d8-617e-4ff9-870c-6ca5163d760a tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:24.371864 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3b64f4d8-617e-4ff9-870c-6ca5163d760a tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:24.372709 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3b64f4d8-617e-4ff9-870c-6ca5163d760a tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:24.373214 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3b64f4d8-617e-4ff9-870c-6ca5163d760a tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:24.373502 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-ba872db8-4098-4ea3-8f56-fd4f00bd08d0 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1260 microversion: 2.1 time: 0.153427 Aug 03 05:16:24.374398 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 215/460] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:24 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:24.459496 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-55ece198-46a7-416d-8cb4-5e71ad17ae90 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:24.460132 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-55ece198-46a7-416d-8cb4-5e71ad17ae90 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] [instance: a21965b8-51d4-4bb6-afb7-053298242bfa] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:24.466697 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-55ece198-46a7-416d-8cb4-5e71ad17ae90 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:24.467173 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-55ece198-46a7-416d-8cb4-5e71ad17ae90 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:24.467948 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-55ece198-46a7-416d-8cb4-5e71ad17ae90 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:24.468389 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-55ece198-46a7-416d-8cb4-5e71ad17ae90 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:24.682987 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-3b64f4d8-617e-4ff9-870c-6ca5163d760a tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:24.690426 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-3b64f4d8-617e-4ff9-870c-6ca5163d760a tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5" status: 200 len: 1677 microversion: 2.1 time: 0.336790 Aug 03 05:16:24.691050 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 246/461] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:24 2022] GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 => generated 1677 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:16:24.695602 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-6bc4f63c-0c4d-499c-beb4-89b0a655e5b6 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:24.696394 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-6bc4f63c-0c4d-499c-beb4-89b0a655e5b6 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] [instance: fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:24.702953 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6bc4f63c-0c4d-499c-beb4-89b0a655e5b6 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:24.703415 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6bc4f63c-0c4d-499c-beb4-89b0a655e5b6 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:24.704189 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6bc4f63c-0c4d-499c-beb4-89b0a655e5b6 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:24.704633 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6bc4f63c-0c4d-499c-beb4-89b0a655e5b6 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:24.706425 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-55ece198-46a7-416d-8cb4-5e71ad17ae90 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff504c0570b24f3baa8744a9740bcfce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a970d4cbb3545a187c75848e10cb166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:24.714131 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-55ece198-46a7-416d-8cb4-5e71ad17ae90 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] 10.222.0.40 "GET /compute/v2.1/servers/a21965b8-51d4-4bb6-afb7-053298242bfa" status: 200 len: 1314 microversion: 2.1 time: 0.258460 Aug 03 05:16:24.714669 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 216/462] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:24 2022] GET /compute/v2.1/servers/a21965b8-51d4-4bb6-afb7-053298242bfa => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:16:24.837128 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-6bc4f63c-0c4d-499c-beb4-89b0a655e5b6 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7d91983dc4c0fb218e7bdbc1c6558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6675985e19c44dabb624420aaa97b0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:24.844795 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-6bc4f63c-0c4d-499c-beb4-89b0a655e5b6 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] 10.222.0.40 "GET /compute/v2.1/servers/fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5" status: 200 len: 1319 microversion: 2.1 time: 0.152821 Aug 03 05:16:24.845360 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 247/463] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:24 2022] GET /compute/v2.1/servers/fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:24.981953 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-84e6a5c4-5073-4f94-a434-06b04142b23a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:24.982611 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-84e6a5c4-5073-4f94-a434-06b04142b23a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:24.988620 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-84e6a5c4-5073-4f94-a434-06b04142b23a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:24.989078 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-84e6a5c4-5073-4f94-a434-06b04142b23a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:24.989853 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-84e6a5c4-5073-4f94-a434-06b04142b23a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:24.990296 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-84e6a5c4-5073-4f94-a434-06b04142b23a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:25.248880 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-84e6a5c4-5073-4f94-a434-06b04142b23a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:25.258074 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-84e6a5c4-5073-4f94-a434-06b04142b23a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:25.259651 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-84e6a5c4-5073-4f94-a434-06b04142b23a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:25.260824 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-84e6a5c4-5073-4f94-a434-06b04142b23a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1806 microversion: 2.20 time: 0.283386 Aug 03 05:16:25.261082 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-122be4c8-5f84-409f-baf8-5ce579200281 req-d6ff5b5e-e00d-4bf2-bae0-9377b03d2db0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a21965b8-51d4-4bb6-afb7-053298242bfa", "tag": "41555d5a-f165-47fa-88be-470e20fd39e2"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:16:25.261564 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 217/464] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:16:24 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1806 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:16:25.271305 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-122be4c8-5f84-409f-baf8-5ce579200281 req-d6ff5b5e-e00d-4bf2-bae0-9377b03d2db0 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:25.271747 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-122be4c8-5f84-409f-baf8-5ce579200281 req-d6ff5b5e-e00d-4bf2-bae0-9377b03d2db0 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:25.283161 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-122be4c8-5f84-409f-baf8-5ce579200281 req-d6ff5b5e-e00d-4bf2-bae0-9377b03d2db0 service nova] Creating event network-changed:41555d5a-f165-47fa-88be-470e20fd39e2 for instance a21965b8-51d4-4bb6-afb7-053298242bfa on hv-cinder-85127 Aug 03 05:16:25.287851 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-122be4c8-5f84-409f-baf8-5ce579200281 req-d6ff5b5e-e00d-4bf2-bae0-9377b03d2db0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030246 Aug 03 05:16:25.288435 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 248/465] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:16:25.289204 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-4b9228ae-1840-473f-8a10-ba32be63a4b3 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:25.289994 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-4b9228ae-1840-473f-8a10-ba32be63a4b3 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] [instance: 363118dd-a0c3-444f-99cb-f0578407e0d2] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:25.296769 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-4b9228ae-1840-473f-8a10-ba32be63a4b3 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:25.297223 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-4b9228ae-1840-473f-8a10-ba32be63a4b3 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:25.297989 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-4b9228ae-1840-473f-8a10-ba32be63a4b3 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:25.298492 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-4b9228ae-1840-473f-8a10-ba32be63a4b3 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:25.395540 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-400fc31d-4a7b-4022-b92b-c80a37fc5301 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:25.396260 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-400fc31d-4a7b-4022-b92b-c80a37fc5301 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:25.403384 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-400fc31d-4a7b-4022-b92b-c80a37fc5301 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:25.403841 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-400fc31d-4a7b-4022-b92b-c80a37fc5301 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:25.404611 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-400fc31d-4a7b-4022-b92b-c80a37fc5301 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:25.405055 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-400fc31d-4a7b-4022-b92b-c80a37fc5301 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:25.423436 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:16:25.429272 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-4b9228ae-1840-473f-8a10-ba32be63a4b3 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79539af2999d48baa11734ced32dccb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d7bf6baa2224b0d910133c5542608e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:25.432765 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_cell1:SELECT=100 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:16:25.437539 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-4b9228ae-1840-473f-8a10-ba32be63a4b3 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2" status: 200 len: 1358 microversion: 2.1 time: 0.151999 Aug 03 05:16:25.438448 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 218/466] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:25 2022] GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:16:25.542910 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-400fc31d-4a7b-4022-b92b-c80a37fc5301 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:25.550211 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-400fc31d-4a7b-4022-b92b-c80a37fc5301 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1260 microversion: 2.1 time: 0.158979 Aug 03 05:16:25.550778 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 249/467] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:25 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:16:25.712673 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-c86e823c-b293-4060-98ce-6636f21eb835 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:25.713945 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-c86e823c-b293-4060-98ce-6636f21eb835 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:25.720648 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-c86e823c-b293-4060-98ce-6636f21eb835 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:25.721105 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-c86e823c-b293-4060-98ce-6636f21eb835 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:25.721905 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-c86e823c-b293-4060-98ce-6636f21eb835 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:25.722455 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-c86e823c-b293-4060-98ce-6636f21eb835 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:25.735156 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-9bacfe1d-4804-41b8-b79f-57248460c120 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:25.735821 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-9bacfe1d-4804-41b8-b79f-57248460c120 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] [instance: a21965b8-51d4-4bb6-afb7-053298242bfa] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:25.741798 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9bacfe1d-4804-41b8-b79f-57248460c120 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:25.742249 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9bacfe1d-4804-41b8-b79f-57248460c120 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:25.743110 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9bacfe1d-4804-41b8-b79f-57248460c120 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:25.743552 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9bacfe1d-4804-41b8-b79f-57248460c120 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:25.917802 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-c86e823c-b293-4060-98ce-6636f21eb835 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:25.928458 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-9bacfe1d-4804-41b8-b79f-57248460c120 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff504c0570b24f3baa8744a9740bcfce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a970d4cbb3545a187c75848e10cb166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:25.932526 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-c86e823c-b293-4060-98ce-6636f21eb835 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5" status: 200 len: 1677 microversion: 2.1 time: 0.216852 Aug 03 05:16:25.933243 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 219/468] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:25 2022] GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 => generated 1677 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:25.938892 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-9bacfe1d-4804-41b8-b79f-57248460c120 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] 10.222.0.40 "GET /compute/v2.1/servers/a21965b8-51d4-4bb6-afb7-053298242bfa" status: 200 len: 1314 microversion: 2.1 time: 0.207450 Aug 03 05:16:25.939458 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 250/469] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:25 2022] GET /compute/v2.1/servers/a21965b8-51d4-4bb6-afb7-053298242bfa => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:16:25.942510 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-0345ca54-f33a-46de-88a3-a38d9de0ff1f tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:25.943151 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-0345ca54-f33a-46de-88a3-a38d9de0ff1f tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] [instance: fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:25.951128 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-0345ca54-f33a-46de-88a3-a38d9de0ff1f tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:25.951772 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-0345ca54-f33a-46de-88a3-a38d9de0ff1f tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:25.952614 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-0345ca54-f33a-46de-88a3-a38d9de0ff1f tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:25.953068 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-0345ca54-f33a-46de-88a3-a38d9de0ff1f tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:26.079106 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-12b4be92-8814-4dc2-9ddb-455b8035fe44 req-6dd04d5c-eb6e-4ec7-9d29-f4acce78fd4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69089938-1d69-415c-8344-e6b9f78f16d1", "name": "network-vif-plugged", "status": "completed", "tag": "602350b3-725c-4735-99e8-acb9b77192fa"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:16:26.089354 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-12b4be92-8814-4dc2-9ddb-455b8035fe44 req-6dd04d5c-eb6e-4ec7-9d29-f4acce78fd4e service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:26.089803 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-12b4be92-8814-4dc2-9ddb-455b8035fe44 req-6dd04d5c-eb6e-4ec7-9d29-f4acce78fd4e service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:26.094781 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-0345ca54-f33a-46de-88a3-a38d9de0ff1f tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7d91983dc4c0fb218e7bdbc1c6558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6675985e19c44dabb624420aaa97b0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:26.102961 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-0345ca54-f33a-46de-88a3-a38d9de0ff1f tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] 10.222.0.40 "GET /compute/v2.1/servers/fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5" status: 200 len: 1319 microversion: 2.1 time: 0.168727 Aug 03 05:16:26.103880 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 220/470] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:25 2022] GET /compute/v2.1/servers/fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:26.109103 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-12b4be92-8814-4dc2-9ddb-455b8035fe44 req-6dd04d5c-eb6e-4ec7-9d29-f4acce78fd4e service nova] Creating event network-vif-plugged:602350b3-725c-4735-99e8-acb9b77192fa for instance 69089938-1d69-415c-8344-e6b9f78f16d1 on hv-cinder-85127 Aug 03 05:16:26.118294 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-12b4be92-8814-4dc2-9ddb-455b8035fe44 req-6dd04d5c-eb6e-4ec7-9d29-f4acce78fd4e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043052 Aug 03 05:16:26.118944 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 251/471] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:16:26.284987 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-4c03e5ea-4c80-4f98-afc6-8e0c7abf39f4 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:26.285588 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-4c03e5ea-4c80-4f98-afc6-8e0c7abf39f4 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:26.292409 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-4c03e5ea-4c80-4f98-afc6-8e0c7abf39f4 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:26.292858 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-4c03e5ea-4c80-4f98-afc6-8e0c7abf39f4 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:26.293612 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-4c03e5ea-4c80-4f98-afc6-8e0c7abf39f4 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:26.294048 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-4c03e5ea-4c80-4f98-afc6-8e0c7abf39f4 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:26.426301 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-4c03e5ea-4c80-4f98-afc6-8e0c7abf39f4 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:26.435338 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-4c03e5ea-4c80-4f98-afc6-8e0c7abf39f4 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:26.436850 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-4c03e5ea-4c80-4f98-afc6-8e0c7abf39f4 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:26.437991 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-4c03e5ea-4c80-4f98-afc6-8e0c7abf39f4 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1806 microversion: 2.20 time: 0.156945 Aug 03 05:16:26.438553 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 221/472] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:16:26 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1806 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:16:26.458786 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-db5a79d6-6661-48d8-944e-97d41d7249ca tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:26.459573 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-db5a79d6-6661-48d8-944e-97d41d7249ca tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] [instance: 363118dd-a0c3-444f-99cb-f0578407e0d2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:26.465965 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-db5a79d6-6661-48d8-944e-97d41d7249ca tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:26.466418 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-db5a79d6-6661-48d8-944e-97d41d7249ca tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:26.467302 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-db5a79d6-6661-48d8-944e-97d41d7249ca tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:26.468815 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-db5a79d6-6661-48d8-944e-97d41d7249ca tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:26.571698 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-3b06089a-57c8-4638-9725-f97bce86e4fa tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:26.571951 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-3b06089a-57c8-4638-9725-f97bce86e4fa tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:26.575265 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:16:26.579733 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3b06089a-57c8-4638-9725-f97bce86e4fa tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:26.580185 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3b06089a-57c8-4638-9725-f97bce86e4fa tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:26.580991 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3b06089a-57c8-4638-9725-f97bce86e4fa tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:26.581427 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3b06089a-57c8-4638-9725-f97bce86e4fa tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:26.608831 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-db5a79d6-6661-48d8-944e-97d41d7249ca tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79539af2999d48baa11734ced32dccb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d7bf6baa2224b0d910133c5542608e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:26.616078 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-db5a79d6-6661-48d8-944e-97d41d7249ca tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2" status: 200 len: 1358 microversion: 2.1 time: 0.161948 Aug 03 05:16:26.621086 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 252/473] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:26 2022] GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:26.730357 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-3b06089a-57c8-4638-9725-f97bce86e4fa tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:26.737709 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-3b06089a-57c8-4638-9725-f97bce86e4fa tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1260 microversion: 2.1 time: 0.170362 Aug 03 05:16:26.738328 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 222/474] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:26 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:16:26.953621 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-45381d26-a41f-4c66-a553-89f615e4317a tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:26.954317 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-45381d26-a41f-4c66-a553-89f615e4317a tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:26.959181 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-bd7d5832-7492-42b8-bf44-526fd396706f tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:26.959789 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-bd7d5832-7492-42b8-bf44-526fd396706f tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] [instance: a21965b8-51d4-4bb6-afb7-053298242bfa] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:26.960706 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-45381d26-a41f-4c66-a553-89f615e4317a tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:26.961233 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-45381d26-a41f-4c66-a553-89f615e4317a tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:26.962102 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-45381d26-a41f-4c66-a553-89f615e4317a tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:26.962621 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-45381d26-a41f-4c66-a553-89f615e4317a tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:26.966610 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-bd7d5832-7492-42b8-bf44-526fd396706f tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:26.967099 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-bd7d5832-7492-42b8-bf44-526fd396706f tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:26.967859 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-bd7d5832-7492-42b8-bf44-526fd396706f tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:26.968298 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-bd7d5832-7492-42b8-bf44-526fd396706f tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:27.288012 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-45381d26-a41f-4c66-a553-89f615e4317a tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:27.292317 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-bd7d5832-7492-42b8-bf44-526fd396706f tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff504c0570b24f3baa8744a9740bcfce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a970d4cbb3545a187c75848e10cb166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:27.296836 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-45381d26-a41f-4c66-a553-89f615e4317a tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5" status: 200 len: 1677 microversion: 2.1 time: 0.347077 Aug 03 05:16:27.297426 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 253/475] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:26 2022] GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 => generated 1677 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:16:27.300522 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-bd7d5832-7492-42b8-bf44-526fd396706f tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] 10.222.0.40 "GET /compute/v2.1/servers/a21965b8-51d4-4bb6-afb7-053298242bfa" status: 200 len: 1314 microversion: 2.1 time: 0.345102 Aug 03 05:16:27.301605 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 223/476] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:26 2022] GET /compute/v2.1/servers/a21965b8-51d4-4bb6-afb7-053298242bfa => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:16:27.302175 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-82264cc3-4d3c-4c43-b3be-f950239ef7cf tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:27.302787 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-82264cc3-4d3c-4c43-b3be-f950239ef7cf tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] [instance: fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:27.308774 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-82264cc3-4d3c-4c43-b3be-f950239ef7cf tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:27.311788 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-82264cc3-4d3c-4c43-b3be-f950239ef7cf tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:27.311788 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-82264cc3-4d3c-4c43-b3be-f950239ef7cf tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:27.311788 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-82264cc3-4d3c-4c43-b3be-f950239ef7cf tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:27.438963 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-82264cc3-4d3c-4c43-b3be-f950239ef7cf tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7d91983dc4c0fb218e7bdbc1c6558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6675985e19c44dabb624420aaa97b0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:27.446382 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-82264cc3-4d3c-4c43-b3be-f950239ef7cf tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] 10.222.0.40 "GET /compute/v2.1/servers/fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5" status: 200 len: 1319 microversion: 2.1 time: 0.147880 Aug 03 05:16:27.446969 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 254/477] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:27 2022] GET /compute/v2.1/servers/fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:27.465846 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-17600172-a2b5-474a-964a-22140ecdec86 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:27.466464 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-17600172-a2b5-474a-964a-22140ecdec86 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:27.472768 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-17600172-a2b5-474a-964a-22140ecdec86 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:27.473984 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-17600172-a2b5-474a-964a-22140ecdec86 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:27.474826 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-17600172-a2b5-474a-964a-22140ecdec86 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:27.475330 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-17600172-a2b5-474a-964a-22140ecdec86 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:27.638973 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-b4174406-e787-4105-87ad-8d7ce5878510 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:27.639788 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-b4174406-e787-4105-87ad-8d7ce5878510 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] [instance: 363118dd-a0c3-444f-99cb-f0578407e0d2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:27.647660 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b4174406-e787-4105-87ad-8d7ce5878510 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:27.648331 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b4174406-e787-4105-87ad-8d7ce5878510 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:27.649595 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b4174406-e787-4105-87ad-8d7ce5878510 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:27.650353 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b4174406-e787-4105-87ad-8d7ce5878510 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:27.676616 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-17600172-a2b5-474a-964a-22140ecdec86 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:27.685936 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-17600172-a2b5-474a-964a-22140ecdec86 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:27.687708 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-17600172-a2b5-474a-964a-22140ecdec86 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:27.688881 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-17600172-a2b5-474a-964a-22140ecdec86 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1806 microversion: 2.20 time: 0.227555 Aug 03 05:16:27.689532 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 224/478] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:16:27 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1806 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:16:27.759176 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-45f4f2d3-74f0-49de-b346-5cd5db195007 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:27.759790 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-45f4f2d3-74f0-49de-b346-5cd5db195007 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:27.765693 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-45f4f2d3-74f0-49de-b346-5cd5db195007 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:27.766139 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-45f4f2d3-74f0-49de-b346-5cd5db195007 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:27.766930 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-45f4f2d3-74f0-49de-b346-5cd5db195007 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:27.767375 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-45f4f2d3-74f0-49de-b346-5cd5db195007 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:27.791733 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-b4174406-e787-4105-87ad-8d7ce5878510 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79539af2999d48baa11734ced32dccb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d7bf6baa2224b0d910133c5542608e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:27.799059 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-b4174406-e787-4105-87ad-8d7ce5878510 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2" status: 200 len: 1549 microversion: 2.1 time: 0.165146 Aug 03 05:16:27.803220 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 255/479] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:27 2022] GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2 => generated 1549 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:27.821014 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-688451b9-bb0a-41ba-aa95-803aa0a912b2 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:27.821631 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-688451b9-bb0a-41ba-aa95-803aa0a912b2 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] [instance: 363118dd-a0c3-444f-99cb-f0578407e0d2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:27.828307 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-688451b9-bb0a-41ba-aa95-803aa0a912b2 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:27.828630 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-688451b9-bb0a-41ba-aa95-803aa0a912b2 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:27.829419 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-688451b9-bb0a-41ba-aa95-803aa0a912b2 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:27.829861 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-688451b9-bb0a-41ba-aa95-803aa0a912b2 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:27.947820 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-45f4f2d3-74f0-49de-b346-5cd5db195007 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:27.955369 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-45f4f2d3-74f0-49de-b346-5cd5db195007 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1260 microversion: 2.1 time: 0.199846 Aug 03 05:16:27.956012 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 225/480] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:27 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1260 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:28.002111 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-688451b9-bb0a-41ba-aa95-803aa0a912b2 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79539af2999d48baa11734ced32dccb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d7bf6baa2224b0d910133c5542608e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:28.011991 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-688451b9-bb0a-41ba-aa95-803aa0a912b2 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2" status: 200 len: 1549 microversion: 2.1 time: 0.195037 Aug 03 05:16:28.012586 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 256/481] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:27 2022] GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2 => generated 1549 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:16:28.032405 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-eee4d726-7782-4d57-86dc-e06156b3a3a6 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:28.037386 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-eee4d726-7782-4d57-86dc-e06156b3a3a6 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '79539af2999d48baa11734ced32dccb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d7bf6baa2224b0d910133c5542608e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:28.038329 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-eee4d726-7782-4d57-86dc-e06156b3a3a6 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Searching by: {'deleted': False, 'project_id': '7d7bf6baa2224b0d910133c5542608e1'} {{(pid=118332) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 05:16:28.046377 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-eee4d726-7782-4d57-86dc-e06156b3a3a6 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:28.046825 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-eee4d726-7782-4d57-86dc-e06156b3a3a6 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:28.047645 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-eee4d726-7782-4d57-86dc-e06156b3a3a6 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:28.048137 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-eee4d726-7782-4d57-86dc-e06156b3a3a6 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:28.137731 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-8a172acd-8a63-4cf2-8f38-f703f913c46d req-960ca198-f89a-4b87-b424-eb03bcd270bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0", "name": "network-vif-plugged", "status": "completed", "tag": "255ebc2e-922a-4b85-be40-f642cc2ae298"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:16:28.142058 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.multi_cell_list [None req-eee4d726-7782-4d57-86dc-e06156b3a3a6 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118332) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 05:16:28.148944 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-8a172acd-8a63-4cf2-8f38-f703f913c46d req-960ca198-f89a-4b87-b424-eb03bcd270bb service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:28.149394 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-8a172acd-8a63-4cf2-8f38-f703f913c46d req-960ca198-f89a-4b87-b424-eb03bcd270bb service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:28.161906 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-8a172acd-8a63-4cf2-8f38-f703f913c46d req-960ca198-f89a-4b87-b424-eb03bcd270bb service nova] Creating event network-vif-plugged:255ebc2e-922a-4b85-be40-f642cc2ae298 for instance b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 on hv-cinder-85127 Aug 03 05:16:28.168253 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-8a172acd-8a63-4cf2-8f38-f703f913c46d req-960ca198-f89a-4b87-b424-eb03bcd270bb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036588 Aug 03 05:16:28.169955 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 257/482] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:16:28.237436 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-eee4d726-7782-4d57-86dc-e06156b3a3a6 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.208983 Aug 03 05:16:28.238026 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 226/483] 10.222.0.40 () {58 vars in 1125 bytes} [Wed Aug 3 05:16:28 2022] GET /compute/v2.1/servers => generated 343 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:16:28.249764 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-28afcc15-29ff-4d23-9e33-f768befc37b6 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:28.250503 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-28afcc15-29ff-4d23-9e33-f768befc37b6 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] [instance: 363118dd-a0c3-444f-99cb-f0578407e0d2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:28.256999 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-28afcc15-29ff-4d23-9e33-f768befc37b6 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:28.257445 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-28afcc15-29ff-4d23-9e33-f768befc37b6 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:28.258216 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-28afcc15-29ff-4d23-9e33-f768befc37b6 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:28.258727 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-28afcc15-29ff-4d23-9e33-f768befc37b6 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:28.317497 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-88a4e7f0-2c99-41d1-86e1-eaeeab19d18d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:28.318731 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-88a4e7f0-2c99-41d1-86e1-eaeeab19d18d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:28.325484 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-88a4e7f0-2c99-41d1-86e1-eaeeab19d18d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:28.325940 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-88a4e7f0-2c99-41d1-86e1-eaeeab19d18d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:28.326716 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-88a4e7f0-2c99-41d1-86e1-eaeeab19d18d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:28.327213 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-88a4e7f0-2c99-41d1-86e1-eaeeab19d18d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:28.435921 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-28afcc15-29ff-4d23-9e33-f768befc37b6 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79539af2999d48baa11734ced32dccb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d7bf6baa2224b0d910133c5542608e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:28.443648 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-28afcc15-29ff-4d23-9e33-f768befc37b6 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2" status: 200 len: 1549 microversion: 2.1 time: 0.198103 Aug 03 05:16:28.444324 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 258/484] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:28 2022] GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2 => generated 1549 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:28.448894 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-01bf6f96-3e03-4887-b315-729dc853cdf6 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:28.449533 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-01bf6f96-3e03-4887-b315-729dc853cdf6 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] [instance: a21965b8-51d4-4bb6-afb7-053298242bfa] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:28.461921 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-01bf6f96-3e03-4887-b315-729dc853cdf6 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:28.462563 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-01bf6f96-3e03-4887-b315-729dc853cdf6 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:28.463875 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-01bf6f96-3e03-4887-b315-729dc853cdf6 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:28.464316 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-01bf6f96-3e03-4887-b315-729dc853cdf6 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:28.485193 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-88a4e7f0-2c99-41d1-86e1-eaeeab19d18d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:28.494129 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-88a4e7f0-2c99-41d1-86e1-eaeeab19d18d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5" status: 200 len: 1677 microversion: 2.1 time: 0.180528 Aug 03 05:16:28.495416 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 227/485] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:28 2022] GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 => generated 1677 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:16:28.501268 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-079b351e-d084-44d2-92bd-64fe2681c5e7 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:28.502372 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-079b351e-d084-44d2-92bd-64fe2681c5e7 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] [instance: fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:28.511515 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-079b351e-d084-44d2-92bd-64fe2681c5e7 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:28.512234 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-079b351e-d084-44d2-92bd-64fe2681c5e7 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:28.513117 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-079b351e-d084-44d2-92bd-64fe2681c5e7 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:28.513816 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-079b351e-d084-44d2-92bd-64fe2681c5e7 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:28.676717 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-01bf6f96-3e03-4887-b315-729dc853cdf6 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff504c0570b24f3baa8744a9740bcfce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a970d4cbb3545a187c75848e10cb166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:28.685095 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-01bf6f96-3e03-4887-b315-729dc853cdf6 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] 10.222.0.40 "GET /compute/v2.1/servers/a21965b8-51d4-4bb6-afb7-053298242bfa" status: 200 len: 1314 microversion: 2.1 time: 0.239646 Aug 03 05:16:28.685949 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 259/486] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:28 2022] GET /compute/v2.1/servers/a21965b8-51d4-4bb6-afb7-053298242bfa => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:28.713043 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-ab3dd71f-0dfb-4f0c-8173-409cdb46b260 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:28.713808 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-ab3dd71f-0dfb-4f0c-8173-409cdb46b260 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:28.721167 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ab3dd71f-0dfb-4f0c-8173-409cdb46b260 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:28.721621 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ab3dd71f-0dfb-4f0c-8173-409cdb46b260 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:28.722667 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ab3dd71f-0dfb-4f0c-8173-409cdb46b260 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:28.723420 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ab3dd71f-0dfb-4f0c-8173-409cdb46b260 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:28.726629 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-079b351e-d084-44d2-92bd-64fe2681c5e7 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7d91983dc4c0fb218e7bdbc1c6558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6675985e19c44dabb624420aaa97b0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:28.735257 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-079b351e-d084-44d2-92bd-64fe2681c5e7 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] 10.222.0.40 "GET /compute/v2.1/servers/fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5" status: 200 len: 1319 microversion: 2.1 time: 0.238455 Aug 03 05:16:28.739826 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 228/487] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:28 2022] GET /compute/v2.1/servers/fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5 => generated 1319 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:28.977033 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-29ad59f6-5c88-47f2-bdb6-4a2596e47962 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:28.977775 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-29ad59f6-5c88-47f2-bdb6-4a2596e47962 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:28.984095 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-29ad59f6-5c88-47f2-bdb6-4a2596e47962 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:28.984548 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-29ad59f6-5c88-47f2-bdb6-4a2596e47962 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:28.985321 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-29ad59f6-5c88-47f2-bdb6-4a2596e47962 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:28.985756 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-29ad59f6-5c88-47f2-bdb6-4a2596e47962 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:29.355842 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-ab3dd71f-0dfb-4f0c-8173-409cdb46b260 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:29.359752 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-29ad59f6-5c88-47f2-bdb6-4a2596e47962 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:29.364307 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-ab3dd71f-0dfb-4f0c-8173-409cdb46b260 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:29.365869 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-ab3dd71f-0dfb-4f0c-8173-409cdb46b260 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:29.367092 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-ab3dd71f-0dfb-4f0c-8173-409cdb46b260 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1806 microversion: 2.20 time: 0.658442 Aug 03 05:16:29.367530 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-29ad59f6-5c88-47f2-bdb6-4a2596e47962 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1260 microversion: 2.1 time: 0.394572 Aug 03 05:16:29.368401 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 229/488] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:28 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1260 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:16:29.373136 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 260/489] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:16:28 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1806 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 05:16:29.516318 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-1ed58eba-029f-4660-9e29-75833e4c133a tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:29.516926 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-1ed58eba-029f-4660-9e29-75833e4c133a tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:29.522878 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-1ed58eba-029f-4660-9e29-75833e4c133a tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:29.523332 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-1ed58eba-029f-4660-9e29-75833e4c133a tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:29.524094 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-1ed58eba-029f-4660-9e29-75833e4c133a tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:29.524529 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-1ed58eba-029f-4660-9e29-75833e4c133a tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:29.652677 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-1ed58eba-029f-4660-9e29-75833e4c133a tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:29.660060 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-1ed58eba-029f-4660-9e29-75833e4c133a tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5" status: 200 len: 1677 microversion: 2.1 time: 0.147611 Aug 03 05:16:29.660630 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 230/490] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:29 2022] GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:29.711983 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-21f7f0cf-441f-421e-833f-133ee8491cba tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:29.712711 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-21f7f0cf-441f-421e-833f-133ee8491cba tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] [instance: a21965b8-51d4-4bb6-afb7-053298242bfa] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:29.719992 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-21f7f0cf-441f-421e-833f-133ee8491cba tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:29.720435 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-21f7f0cf-441f-421e-833f-133ee8491cba tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:29.721182 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-21f7f0cf-441f-421e-833f-133ee8491cba tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:29.721617 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-21f7f0cf-441f-421e-833f-133ee8491cba tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:29.761141 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-9fd5fc36-e908-483b-9f0c-0ca55d5c9b9e tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:29.761755 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-9fd5fc36-e908-483b-9f0c-0ca55d5c9b9e tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] [instance: fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:29.767969 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-9fd5fc36-e908-483b-9f0c-0ca55d5c9b9e tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:29.768349 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-9fd5fc36-e908-483b-9f0c-0ca55d5c9b9e tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:29.769124 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-9fd5fc36-e908-483b-9f0c-0ca55d5c9b9e tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:29.769565 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-9fd5fc36-e908-483b-9f0c-0ca55d5c9b9e tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:29.992992 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-21f7f0cf-441f-421e-833f-133ee8491cba tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff504c0570b24f3baa8744a9740bcfce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a970d4cbb3545a187c75848e10cb166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:30.001352 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-21f7f0cf-441f-421e-833f-133ee8491cba tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] 10.222.0.40 "GET /compute/v2.1/servers/a21965b8-51d4-4bb6-afb7-053298242bfa" status: 200 len: 1314 microversion: 2.1 time: 0.293073 Aug 03 05:16:30.002379 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 261/491] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:29 2022] GET /compute/v2.1/servers/a21965b8-51d4-4bb6-afb7-053298242bfa => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:30.027302 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-9fd5fc36-e908-483b-9f0c-0ca55d5c9b9e tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7d91983dc4c0fb218e7bdbc1c6558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6675985e19c44dabb624420aaa97b0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:30.034674 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-9fd5fc36-e908-483b-9f0c-0ca55d5c9b9e tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] 10.222.0.40 "GET /compute/v2.1/servers/fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5" status: 200 len: 1319 microversion: 2.1 time: 0.277257 Aug 03 05:16:30.035279 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 231/492] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:29 2022] GET /compute/v2.1/servers/fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5 => generated 1319 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:16:30.187661 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-ff78eb75-f67d-450a-9d2e-5c0f9048d385 req-ea61a05c-1282-4027-a988-07fc37bf740b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a21965b8-51d4-4bb6-afb7-053298242bfa", "name": "network-vif-plugged", "status": "completed", "tag": "41555d5a-f165-47fa-88be-470e20fd39e2"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:16:30.196516 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-ff78eb75-f67d-450a-9d2e-5c0f9048d385 req-ea61a05c-1282-4027-a988-07fc37bf740b service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:30.196998 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-ff78eb75-f67d-450a-9d2e-5c0f9048d385 req-ea61a05c-1282-4027-a988-07fc37bf740b service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:30.209069 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-ff78eb75-f67d-450a-9d2e-5c0f9048d385 req-ea61a05c-1282-4027-a988-07fc37bf740b service nova] Creating event network-vif-plugged:41555d5a-f165-47fa-88be-470e20fd39e2 for instance a21965b8-51d4-4bb6-afb7-053298242bfa on hv-cinder-85127 Aug 03 05:16:30.214889 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-ff78eb75-f67d-450a-9d2e-5c0f9048d385 req-ea61a05c-1282-4027-a988-07fc37bf740b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032958 Aug 03 05:16:30.215823 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 262/493] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:16:30.391473 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-cd6dc5cf-9848-4f29-958a-923e5cca8304 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:30.392395 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-a455ed4a-dad5-496b-a452-3543dfcf5987 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:30.392552 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-cd6dc5cf-9848-4f29-958a-923e5cca8304 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:30.393418 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-a455ed4a-dad5-496b-a452-3543dfcf5987 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:30.399046 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-cd6dc5cf-9848-4f29-958a-923e5cca8304 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:30.399498 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-cd6dc5cf-9848-4f29-958a-923e5cca8304 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:30.399633 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a455ed4a-dad5-496b-a452-3543dfcf5987 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:30.400048 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a455ed4a-dad5-496b-a452-3543dfcf5987 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:30.400266 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-cd6dc5cf-9848-4f29-958a-923e5cca8304 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:30.400699 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-cd6dc5cf-9848-4f29-958a-923e5cca8304 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:30.400860 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a455ed4a-dad5-496b-a452-3543dfcf5987 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:30.401308 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a455ed4a-dad5-496b-a452-3543dfcf5987 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:30.602654 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-a455ed4a-dad5-496b-a452-3543dfcf5987 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:30.606974 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-cd6dc5cf-9848-4f29-958a-923e5cca8304 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:30.610387 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-a455ed4a-dad5-496b-a452-3543dfcf5987 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1260 microversion: 2.1 time: 0.222083 Aug 03 05:16:30.610986 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 263/494] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:30 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1260 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:16:30.615778 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-7ed8c92e-6f40-4032-bcfc-eb70889ca365 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a1fea637-e428-48f1-9106-333755de0420"}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:16:30.616928 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-cd6dc5cf-9848-4f29-958a-923e5cca8304 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:30.618201 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-7ed8c92e-6f40-4032-bcfc-eb70889ca365 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] [instance: 363118dd-a0c3-444f-99cb-f0578407e0d2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:30.618631 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-cd6dc5cf-9848-4f29-958a-923e5cca8304 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:30.620473 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-cd6dc5cf-9848-4f29-958a-923e5cca8304 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1806 microversion: 2.20 time: 0.233300 Aug 03 05:16:30.621102 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 232/495] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:16:30 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1806 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:16:30.628285 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7ed8c92e-6f40-4032-bcfc-eb70889ca365 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:30.628738 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7ed8c92e-6f40-4032-bcfc-eb70889ca365 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:30.629518 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7ed8c92e-6f40-4032-bcfc-eb70889ca365 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:30.629967 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7ed8c92e-6f40-4032-bcfc-eb70889ca365 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:30.681455 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-16c94328-ac84-477f-b0d8-a4be2ea55784 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:30.684250 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-16c94328-ac84-477f-b0d8-a4be2ea55784 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:30.691933 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-16c94328-ac84-477f-b0d8-a4be2ea55784 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:30.692385 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-16c94328-ac84-477f-b0d8-a4be2ea55784 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:30.693170 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-16c94328-ac84-477f-b0d8-a4be2ea55784 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:30.693617 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-16c94328-ac84-477f-b0d8-a4be2ea55784 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:30.899801 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-16c94328-ac84-477f-b0d8-a4be2ea55784 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:30.907725 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-16c94328-ac84-477f-b0d8-a4be2ea55784 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5" status: 200 len: 1677 microversion: 2.1 time: 0.230073 Aug 03 05:16:30.908308 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 233/496] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:30 2022] GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 => generated 1677 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:16:31.023056 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-5ea53d98-e862-4330-a021-4d2c4be29aac tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:31.023705 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-5ea53d98-e862-4330-a021-4d2c4be29aac tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] [instance: a21965b8-51d4-4bb6-afb7-053298242bfa] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:31.030036 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-5ea53d98-e862-4330-a021-4d2c4be29aac tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:31.030476 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-5ea53d98-e862-4330-a021-4d2c4be29aac tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:31.031449 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-5ea53d98-e862-4330-a021-4d2c4be29aac tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:31.031807 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-5ea53d98-e862-4330-a021-4d2c4be29aac tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:31.164484 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-5ea53d98-e862-4330-a021-4d2c4be29aac tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff504c0570b24f3baa8744a9740bcfce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a970d4cbb3545a187c75848e10cb166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:31.172948 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-5ea53d98-e862-4330-a021-4d2c4be29aac tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] 10.222.0.40 "GET /compute/v2.1/servers/a21965b8-51d4-4bb6-afb7-053298242bfa" status: 200 len: 1314 microversion: 2.1 time: 0.153856 Aug 03 05:16:31.173548 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 234/497] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:31 2022] GET /compute/v2.1/servers/a21965b8-51d4-4bb6-afb7-053298242bfa => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:16:31.178165 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-d7274f53-8b80-4b09-889b-1bc1862fc713 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:31.178858 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-d7274f53-8b80-4b09-889b-1bc1862fc713 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] [instance: fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:31.198305 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-d7274f53-8b80-4b09-889b-1bc1862fc713 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:31.199240 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-d7274f53-8b80-4b09-889b-1bc1862fc713 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:31.200064 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-d7274f53-8b80-4b09-889b-1bc1862fc713 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:31.200505 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-d7274f53-8b80-4b09-889b-1bc1862fc713 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:31.204773 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_cell1:SELECT=100 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:16:31.333002 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-d7274f53-8b80-4b09-889b-1bc1862fc713 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7d91983dc4c0fb218e7bdbc1c6558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6675985e19c44dabb624420aaa97b0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:31.341314 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-d7274f53-8b80-4b09-889b-1bc1862fc713 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] 10.222.0.40 "GET /compute/v2.1/servers/fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5" status: 200 len: 1319 microversion: 2.1 time: 0.166799 Aug 03 05:16:31.341894 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 235/498] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:31 2022] GET /compute/v2.1/servers/fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:31.631952 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-5a2c2f6b-c955-426d-be7e-33212c87fe78 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:31.632574 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-5a2c2f6b-c955-426d-be7e-33212c87fe78 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:31.647718 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-5a2c2f6b-c955-426d-be7e-33212c87fe78 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:31.648171 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-5a2c2f6b-c955-426d-be7e-33212c87fe78 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:31.648945 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-5a2c2f6b-c955-426d-be7e-33212c87fe78 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:31.649380 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-5a2c2f6b-c955-426d-be7e-33212c87fe78 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:31.808175 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-5a2c2f6b-c955-426d-be7e-33212c87fe78 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:31.817369 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-5a2c2f6b-c955-426d-be7e-33212c87fe78 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1443 microversion: 2.1 time: 0.189125 Aug 03 05:16:31.817952 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 236/499] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:31 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1443 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:31.840747 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-e0eb8bdc-a74d-48f4-859e-eca86c224adc tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:31.841973 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-e0eb8bdc-a74d-48f4-859e-eca86c224adc tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:31.848433 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e0eb8bdc-a74d-48f4-859e-eca86c224adc tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:31.849124 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e0eb8bdc-a74d-48f4-859e-eca86c224adc tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:31.850110 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e0eb8bdc-a74d-48f4-859e-eca86c224adc tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:31.850834 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e0eb8bdc-a74d-48f4-859e-eca86c224adc tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:31.996222 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-e0eb8bdc-a74d-48f4-859e-eca86c224adc tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:32.012190 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-e0eb8bdc-a74d-48f4-859e-eca86c224adc tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:32.013717 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-e0eb8bdc-a74d-48f4-859e-eca86c224adc tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:32.015113 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-e0eb8bdc-a74d-48f4-859e-eca86c224adc tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1806 microversion: 2.20 time: 0.182548 Aug 03 05:16:32.015790 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 237/500] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:16:31 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1806 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:16:32.020173 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-e5b16ab8-174f-4a5e-8c96-c03d04613540 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:32.020782 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-e5b16ab8-174f-4a5e-8c96-c03d04613540 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:32.027829 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e5b16ab8-174f-4a5e-8c96-c03d04613540 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:32.028301 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e5b16ab8-174f-4a5e-8c96-c03d04613540 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:32.031353 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e5b16ab8-174f-4a5e-8c96-c03d04613540 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:32.031353 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e5b16ab8-174f-4a5e-8c96-c03d04613540 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:32.177332 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-7ed8c92e-6f40-4032-bcfc-eb70889ca365 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "POST /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.554701 Aug 03 05:16:32.177332 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 264/501] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Aug 3 05:16:30 2022] POST /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2/os-volume_attachments => generated 194 bytes in 1557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:16:32.194622 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-47f7d027-bc5a-4dac-b47d-5f8a31adf345 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:32.195370 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-47f7d027-bc5a-4dac-b47d-5f8a31adf345 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:32.209712 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-47f7d027-bc5a-4dac-b47d-5f8a31adf345 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:32.210588 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-47f7d027-bc5a-4dac-b47d-5f8a31adf345 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:32.211407 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-47f7d027-bc5a-4dac-b47d-5f8a31adf345 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:32.211856 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-47f7d027-bc5a-4dac-b47d-5f8a31adf345 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:32.238256 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-e5b16ab8-174f-4a5e-8c96-c03d04613540 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:32.247371 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-e5b16ab8-174f-4a5e-8c96-c03d04613540 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1443 microversion: 2.1 time: 0.230370 Aug 03 05:16:32.247972 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 238/502] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:32 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1443 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:32.269232 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-266f9ec7-342f-4b44-963d-5e5be2c9b521 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:32.269854 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-266f9ec7-342f-4b44-963d-5e5be2c9b521 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] [instance: a21965b8-51d4-4bb6-afb7-053298242bfa] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:32.294269 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-266f9ec7-342f-4b44-963d-5e5be2c9b521 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:32.300009 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-266f9ec7-342f-4b44-963d-5e5be2c9b521 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:32.301153 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-266f9ec7-342f-4b44-963d-5e5be2c9b521 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:32.301678 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-266f9ec7-342f-4b44-963d-5e5be2c9b521 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:32.426349 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-47f7d027-bc5a-4dac-b47d-5f8a31adf345 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:32.435281 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-47f7d027-bc5a-4dac-b47d-5f8a31adf345 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5" status: 200 len: 1654 microversion: 2.1 time: 0.265915 Aug 03 05:16:32.436002 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 265/503] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:32 2022] GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 => generated 1654 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:32.440849 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-a4d598fe-8908-424e-8505-0b7532b085c6 req-95ece2d2-a9ed-4a6b-ac74-fba04de48493 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5", "name": "network-vif-plugged", "status": "completed", "tag": "97f8fdc6-81d2-4bf6-91c7-f43776182afd"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:16:32.453189 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-a4d598fe-8908-424e-8505-0b7532b085c6 req-95ece2d2-a9ed-4a6b-ac74-fba04de48493 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:32.453649 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-a4d598fe-8908-424e-8505-0b7532b085c6 req-95ece2d2-a9ed-4a6b-ac74-fba04de48493 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:32.465763 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-a4d598fe-8908-424e-8505-0b7532b085c6 req-95ece2d2-a9ed-4a6b-ac74-fba04de48493 service nova] Creating event network-vif-plugged:97f8fdc6-81d2-4bf6-91c7-f43776182afd for instance fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5 on hv-cinder-85127 Aug 03 05:16:32.470997 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-a4d598fe-8908-424e-8505-0b7532b085c6 req-95ece2d2-a9ed-4a6b-ac74-fba04de48493 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033541 Aug 03 05:16:32.471980 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 266/504] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:16:32.477212 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-682cc3a4-1402-4dc1-b08c-3251bc2390ed tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:32.477911 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-682cc3a4-1402-4dc1-b08c-3251bc2390ed tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] [instance: fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:32.484820 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-682cc3a4-1402-4dc1-b08c-3251bc2390ed tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:32.485262 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-682cc3a4-1402-4dc1-b08c-3251bc2390ed tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:32.493391 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-682cc3a4-1402-4dc1-b08c-3251bc2390ed tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:32.493391 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-682cc3a4-1402-4dc1-b08c-3251bc2390ed tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:32.493747 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-266f9ec7-342f-4b44-963d-5e5be2c9b521 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff504c0570b24f3baa8744a9740bcfce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a970d4cbb3545a187c75848e10cb166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:32.495947 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-266f9ec7-342f-4b44-963d-5e5be2c9b521 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] 10.222.0.40 "GET /compute/v2.1/servers/a21965b8-51d4-4bb6-afb7-053298242bfa" status: 200 len: 1314 microversion: 2.1 time: 0.236249 Aug 03 05:16:32.496530 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 239/505] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:32 2022] GET /compute/v2.1/servers/a21965b8-51d4-4bb6-afb7-053298242bfa => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:32.510107 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-8b632825-18a3-4311-a849-153b789f72a3 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:16:32.510286 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:16:32.510399 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-8b632825-18a3-4311-a849-153b789f72a3 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:32.510399 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-8b632825-18a3-4311-a849-153b789f72a3 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:32.533033 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-8b632825-18a3-4311-a849-153b789f72a3 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Going to try to start instance {{(pid=118332) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 03 05:16:32.674627 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-682cc3a4-1402-4dc1-b08c-3251bc2390ed tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7d91983dc4c0fb218e7bdbc1c6558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6675985e19c44dabb624420aaa97b0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:32.686228 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-682cc3a4-1402-4dc1-b08c-3251bc2390ed tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] 10.222.0.40 "GET /compute/v2.1/servers/fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5" status: 200 len: 1319 microversion: 2.1 time: 0.210646 Aug 03 05:16:32.688242 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 267/506] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:32 2022] GET /compute/v2.1/servers/fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5 => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:32.816040 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-8b632825-18a3-4311-a849-153b789f72a3 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "POST /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5/action" status: 202 len: 0 microversion: 2.1 time: 0.318281 Aug 03 05:16:32.819642 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 240/507] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Aug 3 05:16:32 2022] POST /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5/action => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:16:32.824925 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-7e8b7e66-7e53-4dec-8c20-c80e417b97a4 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:32.825571 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-7e8b7e66-7e53-4dec-8c20-c80e417b97a4 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:32.834465 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7e8b7e66-7e53-4dec-8c20-c80e417b97a4 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:32.834964 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7e8b7e66-7e53-4dec-8c20-c80e417b97a4 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:32.835742 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7e8b7e66-7e53-4dec-8c20-c80e417b97a4 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:32.836186 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7e8b7e66-7e53-4dec-8c20-c80e417b97a4 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:32.975637 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-7e8b7e66-7e53-4dec-8c20-c80e417b97a4 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:32.985294 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-7e8b7e66-7e53-4dec-8c20-c80e417b97a4 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5" status: 200 len: 1663 microversion: 2.1 time: 0.164207 Aug 03 05:16:32.986233 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 268/508] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:32 2022] GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 => generated 1663 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:33.040289 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-a7c8a5ba-e4fb-4f05-b070-67e1e25e2d17 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:33.040983 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-a7c8a5ba-e4fb-4f05-b070-67e1e25e2d17 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:33.047231 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-a7c8a5ba-e4fb-4f05-b070-67e1e25e2d17 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:33.047678 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-a7c8a5ba-e4fb-4f05-b070-67e1e25e2d17 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:33.048478 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-a7c8a5ba-e4fb-4f05-b070-67e1e25e2d17 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:33.048912 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-a7c8a5ba-e4fb-4f05-b070-67e1e25e2d17 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:33.183822 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-a7c8a5ba-e4fb-4f05-b070-67e1e25e2d17 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:33.194083 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-a7c8a5ba-e4fb-4f05-b070-67e1e25e2d17 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:33.195744 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-a7c8a5ba-e4fb-4f05-b070-67e1e25e2d17 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:33.196980 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-a7c8a5ba-e4fb-4f05-b070-67e1e25e2d17 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1806 microversion: 2.20 time: 0.161049 Aug 03 05:16:33.198180 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 241/509] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:16:33 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1806 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 05:16:33.518692 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-bb5d85b8-1a56-42dd-b92c-345797fe31f0 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:33.519356 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-bb5d85b8-1a56-42dd-b92c-345797fe31f0 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] [instance: a21965b8-51d4-4bb6-afb7-053298242bfa] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:33.525465 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bb5d85b8-1a56-42dd-b92c-345797fe31f0 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:33.525926 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bb5d85b8-1a56-42dd-b92c-345797fe31f0 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:33.526685 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bb5d85b8-1a56-42dd-b92c-345797fe31f0 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:33.527244 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bb5d85b8-1a56-42dd-b92c-345797fe31f0 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:33.662533 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-bb5d85b8-1a56-42dd-b92c-345797fe31f0 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff504c0570b24f3baa8744a9740bcfce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a970d4cbb3545a187c75848e10cb166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:33.670019 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-bb5d85b8-1a56-42dd-b92c-345797fe31f0 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] 10.222.0.40 "GET /compute/v2.1/servers/a21965b8-51d4-4bb6-afb7-053298242bfa" status: 200 len: 1314 microversion: 2.1 time: 0.155294 Aug 03 05:16:33.670574 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 269/510] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:33 2022] GET /compute/v2.1/servers/a21965b8-51d4-4bb6-afb7-053298242bfa => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:33.714742 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-97391f1c-273e-45b2-92d1-23eabc2f813b tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:33.715588 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-97391f1c-273e-45b2-92d1-23eabc2f813b tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] [instance: fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:33.721716 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-97391f1c-273e-45b2-92d1-23eabc2f813b tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:33.722377 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-97391f1c-273e-45b2-92d1-23eabc2f813b tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:33.722938 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-97391f1c-273e-45b2-92d1-23eabc2f813b tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:33.723381 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-97391f1c-273e-45b2-92d1-23eabc2f813b tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:33.865925 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-97391f1c-273e-45b2-92d1-23eabc2f813b tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7d91983dc4c0fb218e7bdbc1c6558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6675985e19c44dabb624420aaa97b0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:33.876754 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-97391f1c-273e-45b2-92d1-23eabc2f813b tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] 10.222.0.40 "GET /compute/v2.1/servers/fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5" status: 200 len: 1319 microversion: 2.1 time: 0.165948 Aug 03 05:16:33.890451 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 242/511] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:33 2022] GET /compute/v2.1/servers/fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:34.008255 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-7659bf99-471d-44d7-8a23-d380d68650e2 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:34.008909 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-7659bf99-471d-44d7-8a23-d380d68650e2 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:34.015561 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7659bf99-471d-44d7-8a23-d380d68650e2 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:34.016641 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7659bf99-471d-44d7-8a23-d380d68650e2 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:34.017430 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7659bf99-471d-44d7-8a23-d380d68650e2 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:34.017870 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7659bf99-471d-44d7-8a23-d380d68650e2 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:34.148331 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-7659bf99-471d-44d7-8a23-d380d68650e2 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:34.156451 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-7659bf99-471d-44d7-8a23-d380d68650e2 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5" status: 200 len: 1663 microversion: 2.1 time: 0.153148 Aug 03 05:16:34.157197 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 270/512] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:34 2022] GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 => generated 1663 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:34.221632 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-3fed8f75-9cad-488f-b1c0-bdaf859fc754 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:34.222364 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-3fed8f75-9cad-488f-b1c0-bdaf859fc754 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:34.229278 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3fed8f75-9cad-488f-b1c0-bdaf859fc754 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:34.229812 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3fed8f75-9cad-488f-b1c0-bdaf859fc754 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:34.230653 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3fed8f75-9cad-488f-b1c0-bdaf859fc754 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:34.231185 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3fed8f75-9cad-488f-b1c0-bdaf859fc754 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:34.367920 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-7cfebdca-3986-4d01-ab34-6e262b515fdd req-3b0a4f97-484a-4aa1-9176-1684ff77b416 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0", "tag": "255ebc2e-922a-4b85-be40-f642cc2ae298"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:16:34.379674 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-7cfebdca-3986-4d01-ab34-6e262b515fdd req-3b0a4f97-484a-4aa1-9176-1684ff77b416 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:34.380437 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-7cfebdca-3986-4d01-ab34-6e262b515fdd req-3b0a4f97-484a-4aa1-9176-1684ff77b416 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:34.394245 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-7cfebdca-3986-4d01-ab34-6e262b515fdd req-3b0a4f97-484a-4aa1-9176-1684ff77b416 service nova] Creating event network-changed:255ebc2e-922a-4b85-be40-f642cc2ae298 for instance b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 on hv-cinder-85127 Aug 03 05:16:34.401449 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-7cfebdca-3986-4d01-ab34-6e262b515fdd req-3b0a4f97-484a-4aa1-9176-1684ff77b416 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037636 Aug 03 05:16:34.402053 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 271/513] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:16:34.436427 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-3fed8f75-9cad-488f-b1c0-bdaf859fc754 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:34.445150 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-3fed8f75-9cad-488f-b1c0-bdaf859fc754 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:34.446916 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-3fed8f75-9cad-488f-b1c0-bdaf859fc754 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:34.448183 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-3fed8f75-9cad-488f-b1c0-bdaf859fc754 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1793 microversion: 2.20 time: 0.230550 Aug 03 05:16:34.448833 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 243/514] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:16:34 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1793 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:16:34.691538 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-0078ee6f-4218-4c1b-b999-a9624fb3a447 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:34.692252 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-0078ee6f-4218-4c1b-b999-a9624fb3a447 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] [instance: a21965b8-51d4-4bb6-afb7-053298242bfa] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:34.699290 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0078ee6f-4218-4c1b-b999-a9624fb3a447 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:34.699779 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0078ee6f-4218-4c1b-b999-a9624fb3a447 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:34.700545 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0078ee6f-4218-4c1b-b999-a9624fb3a447 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:34.700987 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0078ee6f-4218-4c1b-b999-a9624fb3a447 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:34.853154 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-0078ee6f-4218-4c1b-b999-a9624fb3a447 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff504c0570b24f3baa8744a9740bcfce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a970d4cbb3545a187c75848e10cb166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:34.862532 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-0078ee6f-4218-4c1b-b999-a9624fb3a447 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] 10.222.0.40 "GET /compute/v2.1/servers/a21965b8-51d4-4bb6-afb7-053298242bfa" status: 200 len: 1463 microversion: 2.1 time: 0.174996 Aug 03 05:16:34.863625 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 272/515] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:34 2022] GET /compute/v2.1/servers/a21965b8-51d4-4bb6-afb7-053298242bfa => generated 1463 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:34.898161 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-933d3c40-dd30-4fb1-acce-cbfa825efb4a tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:34.898863 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-933d3c40-dd30-4fb1-acce-cbfa825efb4a tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] [instance: fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:34.912716 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-a5af96b7-dc34-4e47-b4ca-1a47d8ffdc17 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:34.913206 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-a5af96b7-dc34-4e47-b4ca-1a47d8ffdc17 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] [instance: a21965b8-51d4-4bb6-afb7-053298242bfa] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:34.917091 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-933d3c40-dd30-4fb1-acce-cbfa825efb4a tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:34.917540 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-933d3c40-dd30-4fb1-acce-cbfa825efb4a tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:34.918313 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-933d3c40-dd30-4fb1-acce-cbfa825efb4a tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:34.918746 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-933d3c40-dd30-4fb1-acce-cbfa825efb4a tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:34.922219 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a5af96b7-dc34-4e47-b4ca-1a47d8ffdc17 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:34.922662 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a5af96b7-dc34-4e47-b4ca-1a47d8ffdc17 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:34.923443 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a5af96b7-dc34-4e47-b4ca-1a47d8ffdc17 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:34.923876 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a5af96b7-dc34-4e47-b4ca-1a47d8ffdc17 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:34.969966 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-a5af96b7-dc34-4e47-b4ca-1a47d8ffdc17 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] [instance: a21965b8-51d4-4bb6-afb7-053298242bfa] Going to try to terminate instance {{(pid=118331) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:16:35.212703 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-933d3c40-dd30-4fb1-acce-cbfa825efb4a tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7d91983dc4c0fb218e7bdbc1c6558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6675985e19c44dabb624420aaa97b0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:35.220871 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-933d3c40-dd30-4fb1-acce-cbfa825efb4a tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] 10.222.0.40 "GET /compute/v2.1/servers/fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5" status: 200 len: 1319 microversion: 2.1 time: 0.327166 Aug 03 05:16:35.221473 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 244/516] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:34 2022] GET /compute/v2.1/servers/fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5 => generated 1319 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:35.226722 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-64bd7a91-a00f-4374-9774-309449bffa52 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2f946b6e-7213-470a-a9a1-0a1110fd5385"}} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:16:35.231509 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-64bd7a91-a00f-4374-9774-309449bffa52 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:35.239861 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-64bd7a91-a00f-4374-9774-309449bffa52 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:35.240336 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-64bd7a91-a00f-4374-9774-309449bffa52 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:35.241117 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-64bd7a91-a00f-4374-9774-309449bffa52 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:35.241563 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-64bd7a91-a00f-4374-9774-309449bffa52 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:35.252301 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-a5af96b7-dc34-4e47-b4ca-1a47d8ffdc17 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a21965b8-51d4-4bb6-afb7-053298242bfa" status: 204 len: 0 microversion: 2.1 time: 0.343602 Aug 03 05:16:35.253235 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 273/517] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Aug 3 05:16:34 2022] DELETE /compute/v2.1/servers/a21965b8-51d4-4bb6-afb7-053298242bfa => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 05:16:35.260753 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-5bcdf16f-d58e-4455-9f43-48fa571b36bb tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:35.260753 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-5bcdf16f-d58e-4455-9f43-48fa571b36bb tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:35.266935 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5bcdf16f-d58e-4455-9f43-48fa571b36bb tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:35.267388 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5bcdf16f-d58e-4455-9f43-48fa571b36bb tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:35.268295 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5bcdf16f-d58e-4455-9f43-48fa571b36bb tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:35.268742 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5bcdf16f-d58e-4455-9f43-48fa571b36bb tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:35.412510 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-5bcdf16f-d58e-4455-9f43-48fa571b36bb tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:35.420858 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-5bcdf16f-d58e-4455-9f43-48fa571b36bb tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5" status: 200 len: 1663 microversion: 2.1 time: 0.166408 Aug 03 05:16:35.426904 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 274/518] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:35 2022] GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 => generated 1663 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:35.426904 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-4779fcbe-e3e4-4ca5-a123-fe1b5b7f39c2 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:35.427414 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-4779fcbe-e3e4-4ca5-a123-fe1b5b7f39c2 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] [instance: a21965b8-51d4-4bb6-afb7-053298242bfa] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:35.430234 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:16:35.434928 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4779fcbe-e3e4-4ca5-a123-fe1b5b7f39c2 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:35.435532 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4779fcbe-e3e4-4ca5-a123-fe1b5b7f39c2 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:35.436153 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4779fcbe-e3e4-4ca5-a123-fe1b5b7f39c2 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:35.436599 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4779fcbe-e3e4-4ca5-a123-fe1b5b7f39c2 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:35.585892 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-4779fcbe-e3e4-4ca5-a123-fe1b5b7f39c2 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff504c0570b24f3baa8744a9740bcfce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a970d4cbb3545a187c75848e10cb166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:35.594351 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-4779fcbe-e3e4-4ca5-a123-fe1b5b7f39c2 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] 10.222.0.40 "GET /compute/v2.1/servers/a21965b8-51d4-4bb6-afb7-053298242bfa" status: 200 len: 1469 microversion: 2.1 time: 0.171903 Aug 03 05:16:35.594944 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 275/519] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:35 2022] GET /compute/v2.1/servers/a21965b8-51d4-4bb6-afb7-053298242bfa => generated 1469 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:36.242611 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-f7b08c69-3299-42e9-944a-3719a2c2d05a tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:36.243329 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-f7b08c69-3299-42e9-944a-3719a2c2d05a tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] [instance: fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:36.249672 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f7b08c69-3299-42e9-944a-3719a2c2d05a tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:36.250110 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f7b08c69-3299-42e9-944a-3719a2c2d05a tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:36.251379 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f7b08c69-3299-42e9-944a-3719a2c2d05a tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:36.251820 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f7b08c69-3299-42e9-944a-3719a2c2d05a tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:36.381657 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-f7b08c69-3299-42e9-944a-3719a2c2d05a tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7d91983dc4c0fb218e7bdbc1c6558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6675985e19c44dabb624420aaa97b0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:36.389661 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-f7b08c69-3299-42e9-944a-3719a2c2d05a tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] 10.222.0.40 "GET /compute/v2.1/servers/fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5" status: 200 len: 1508 microversion: 2.1 time: 0.150910 Aug 03 05:16:36.390222 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 276/520] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:36 2022] GET /compute/v2.1/servers/fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:16:36.443131 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-70f9b7e6-e14c-4858-9297-35f8f8b4537f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:36.443738 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-70f9b7e6-e14c-4858-9297-35f8f8b4537f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:36.450552 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-70f9b7e6-e14c-4858-9297-35f8f8b4537f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:36.451037 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-70f9b7e6-e14c-4858-9297-35f8f8b4537f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:36.452339 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-70f9b7e6-e14c-4858-9297-35f8f8b4537f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:36.452842 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-70f9b7e6-e14c-4858-9297-35f8f8b4537f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:36.598705 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-70f9b7e6-e14c-4858-9297-35f8f8b4537f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:36.606703 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-70f9b7e6-e14c-4858-9297-35f8f8b4537f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5" status: 200 len: 1663 microversion: 2.1 time: 0.167544 Aug 03 05:16:36.619296 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 277/521] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:36 2022] GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 => generated 1663 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:16:36.619296 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-8e141efa-952f-4322-9641-ad020611223b tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:36.619296 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-8e141efa-952f-4322-9641-ad020611223b tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] [instance: a21965b8-51d4-4bb6-afb7-053298242bfa] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:36.623072 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8e141efa-952f-4322-9641-ad020611223b tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:36.623761 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8e141efa-952f-4322-9641-ad020611223b tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:36.624521 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8e141efa-952f-4322-9641-ad020611223b tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:36.624956 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8e141efa-952f-4322-9641-ad020611223b tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:36.770182 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-8e141efa-952f-4322-9641-ad020611223b tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff504c0570b24f3baa8744a9740bcfce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a970d4cbb3545a187c75848e10cb166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:36.778176 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-8e141efa-952f-4322-9641-ad020611223b tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] 10.222.0.40 "GET /compute/v2.1/servers/a21965b8-51d4-4bb6-afb7-053298242bfa" status: 200 len: 1469 microversion: 2.1 time: 0.166308 Aug 03 05:16:36.778753 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 278/522] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:36 2022] GET /compute/v2.1/servers/a21965b8-51d4-4bb6-afb7-053298242bfa => generated 1469 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:16:37.632524 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-fa518f6a-3022-47cc-8b35-1ef3fba32c5f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:37.633189 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-fa518f6a-3022-47cc-8b35-1ef3fba32c5f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:37.652261 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fa518f6a-3022-47cc-8b35-1ef3fba32c5f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:37.653341 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fa518f6a-3022-47cc-8b35-1ef3fba32c5f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:37.654699 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fa518f6a-3022-47cc-8b35-1ef3fba32c5f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:37.655176 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fa518f6a-3022-47cc-8b35-1ef3fba32c5f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:37.893727 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-fa518f6a-3022-47cc-8b35-1ef3fba32c5f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:37.902936 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-fa518f6a-3022-47cc-8b35-1ef3fba32c5f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5" status: 200 len: 1663 microversion: 2.1 time: 0.275252 Aug 03 05:16:37.902936 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 279/523] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:37 2022] GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 => generated 1663 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:37.906587 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-2565ee97-275e-4a41-ba25-84c3168a2eb8 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:37.907223 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-2565ee97-275e-4a41-ba25-84c3168a2eb8 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] [instance: a21965b8-51d4-4bb6-afb7-053298242bfa] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:37.913174 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2565ee97-275e-4a41-ba25-84c3168a2eb8 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:37.913629 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2565ee97-275e-4a41-ba25-84c3168a2eb8 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:37.914402 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2565ee97-275e-4a41-ba25-84c3168a2eb8 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:37.914871 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2565ee97-275e-4a41-ba25-84c3168a2eb8 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:37.928408 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-64bd7a91-a00f-4374-9774-309449bffa52 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "POST /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.705452 Aug 03 05:16:37.929222 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 245/524] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Aug 3 05:16:35 2022] POST /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7/os-volume_attachments => generated 194 bytes in 2707 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:16:38.073934 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-2565ee97-275e-4a41-ba25-84c3168a2eb8 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff504c0570b24f3baa8744a9740bcfce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a970d4cbb3545a187c75848e10cb166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:38.082901 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-2565ee97-275e-4a41-ba25-84c3168a2eb8 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] 10.222.0.40 "GET /compute/v2.1/servers/a21965b8-51d4-4bb6-afb7-053298242bfa" status: 200 len: 1469 microversion: 2.1 time: 0.179837 Aug 03 05:16:38.084170 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 280/525] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:37 2022] GET /compute/v2.1/servers/a21965b8-51d4-4bb6-afb7-053298242bfa => generated 1469 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:38.324084 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [req-8e5b4052-04b3-4c91-824f-e40d5d18c4ea req-da1db0f0-f24d-4815-a175-457a2f2c3c25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a21965b8-51d4-4bb6-afb7-053298242bfa", "name": "network-vif-deleted", "tag": "41555d5a-f165-47fa-88be-470e20fd39e2"}]} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:16:38.329185 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_cell0:SELECT=2 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:16:38.336225 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-8e5b4052-04b3-4c91-824f-e40d5d18c4ea req-da1db0f0-f24d-4815-a175-457a2f2c3c25 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:38.336679 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-8e5b4052-04b3-4c91-824f-e40d5d18c4ea req-da1db0f0-f24d-4815-a175-457a2f2c3c25 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:38.348398 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.compute.server_external_events [req-8e5b4052-04b3-4c91-824f-e40d5d18c4ea req-da1db0f0-f24d-4815-a175-457a2f2c3c25 service nova] Creating event network-vif-deleted:41555d5a-f165-47fa-88be-470e20fd39e2 for instance a21965b8-51d4-4bb6-afb7-053298242bfa on hv-cinder-85127 Aug 03 05:16:38.353860 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [req-8e5b4052-04b3-4c91-824f-e40d5d18c4ea req-da1db0f0-f24d-4815-a175-457a2f2c3c25 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033588 Aug 03 05:16:38.354474 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 246/526] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:16:38.923406 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-2e7152a4-5dd1-4f8b-99b4-33b663b94b67 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:38.923955 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-2e7152a4-5dd1-4f8b-99b4-33b663b94b67 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:38.930689 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2e7152a4-5dd1-4f8b-99b4-33b663b94b67 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:38.931183 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2e7152a4-5dd1-4f8b-99b4-33b663b94b67 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:38.931968 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2e7152a4-5dd1-4f8b-99b4-33b663b94b67 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:38.932427 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2e7152a4-5dd1-4f8b-99b4-33b663b94b67 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:39.064334 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-2e7152a4-5dd1-4f8b-99b4-33b663b94b67 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:39.072537 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-2e7152a4-5dd1-4f8b-99b4-33b663b94b67 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5" status: 200 len: 1663 microversion: 2.1 time: 0.152568 Aug 03 05:16:39.073107 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 281/527] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:38 2022] GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 => generated 1663 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:39.105489 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-640ec1c9-557a-4324-8a35-be1483ca8785 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:39.106191 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-640ec1c9-557a-4324-8a35-be1483ca8785 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] [instance: a21965b8-51d4-4bb6-afb7-053298242bfa] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:39.112975 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-640ec1c9-557a-4324-8a35-be1483ca8785 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:39.113439 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-640ec1c9-557a-4324-8a35-be1483ca8785 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:39.114242 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-640ec1c9-557a-4324-8a35-be1483ca8785 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:39.114689 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-640ec1c9-557a-4324-8a35-be1483ca8785 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:39.180785 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-640ec1c9-557a-4324-8a35-be1483ca8785 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff504c0570b24f3baa8744a9740bcfce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a970d4cbb3545a187c75848e10cb166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:39.188270 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-640ec1c9-557a-4324-8a35-be1483ca8785 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] 10.222.0.40 "GET /compute/v2.1/servers/a21965b8-51d4-4bb6-afb7-053298242bfa" status: 200 len: 1427 microversion: 2.1 time: 0.087003 Aug 03 05:16:39.188847 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 247/528] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:39 2022] GET /compute/v2.1/servers/a21965b8-51d4-4bb6-afb7-053298242bfa => generated 1427 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:40.094282 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-e8667804-a7e3-445a-84d7-83ffb738d204 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:40.094916 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-e8667804-a7e3-445a-84d7-83ffb738d204 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:40.101617 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e8667804-a7e3-445a-84d7-83ffb738d204 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:40.102106 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e8667804-a7e3-445a-84d7-83ffb738d204 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:40.102826 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e8667804-a7e3-445a-84d7-83ffb738d204 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:40.103888 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e8667804-a7e3-445a-84d7-83ffb738d204 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:40.209367 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-f1583ed5-7f83-4a5c-b508-3e6e73df1557 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:40.209967 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-f1583ed5-7f83-4a5c-b508-3e6e73df1557 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] [instance: a21965b8-51d4-4bb6-afb7-053298242bfa] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:40.217764 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f1583ed5-7f83-4a5c-b508-3e6e73df1557 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:40.218189 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f1583ed5-7f83-4a5c-b508-3e6e73df1557 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:40.219006 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f1583ed5-7f83-4a5c-b508-3e6e73df1557 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:40.219476 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f1583ed5-7f83-4a5c-b508-3e6e73df1557 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:40.253694 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f1583ed5-7f83-4a5c-b508-3e6e73df1557 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:40.254014 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f1583ed5-7f83-4a5c-b508-3e6e73df1557 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:40.254453 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.objects.instance [None req-f1583ed5-7f83-4a5c-b508-3e6e73df1557 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lazy-loading 'fault' on Instance uuid a21965b8-51d4-4bb6-afb7-053298242bfa {{(pid=118332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:16:40.481594 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-f1583ed5-7f83-4a5c-b508-3e6e73df1557 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff504c0570b24f3baa8744a9740bcfce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a970d4cbb3545a187c75848e10cb166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:40.490076 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-f1583ed5-7f83-4a5c-b508-3e6e73df1557 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] 10.222.0.40 "GET /compute/v2.1/servers/a21965b8-51d4-4bb6-afb7-053298242bfa" status: 200 len: 1304 microversion: 2.1 time: 0.284580 Aug 03 05:16:40.490677 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 248/529] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:40 2022] GET /compute/v2.1/servers/a21965b8-51d4-4bb6-afb7-053298242bfa => generated 1304 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:16:40.507734 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-e8667804-a7e3-445a-84d7-83ffb738d204 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:40.515867 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-e8667804-a7e3-445a-84d7-83ffb738d204 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5" status: 200 len: 1667 microversion: 2.1 time: 0.425769 Aug 03 05:16:40.516430 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 282/530] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:40 2022] GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 => generated 1667 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:41.512893 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-33111c70-e38b-4c2c-829a-c6e9f3b98748 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:41.513702 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-33111c70-e38b-4c2c-829a-c6e9f3b98748 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] [instance: a21965b8-51d4-4bb6-afb7-053298242bfa] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:41.520469 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-33111c70-e38b-4c2c-829a-c6e9f3b98748 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:41.520970 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-33111c70-e38b-4c2c-829a-c6e9f3b98748 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:41.521700 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-33111c70-e38b-4c2c-829a-c6e9f3b98748 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:41.522147 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-33111c70-e38b-4c2c-829a-c6e9f3b98748 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:41.537659 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.wsgi [None req-33111c70-e38b-4c2c-829a-c6e9f3b98748 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] HTTP exception thrown: Instance a21965b8-51d4-4bb6-afb7-053298242bfa could not be found. Aug 03 05:16:41.539384 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-33111c70-e38b-4c2c-829a-c6e9f3b98748 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Request method failure captured: Aug 03 05:16:41.539384 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: request: GET /compute/v2.1/servers/a21965b8-51d4-4bb6-afb7-053298242bfa HTTP/1.1 Aug 03 05:16:41.539384 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Accept: application/json Aug 03 05:16:41.539384 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Accept-Encoding: identity Aug 03 05:16:41.539384 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Connection: close Aug 03 05:16:41.539384 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Content-Length: 0 Aug 03 05:16:41.539384 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Content-Type: application/json Aug 03 05:16:41.539384 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Host: 10.222.0.40 Aug 03 05:16:41.539384 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Openstack-System-Scope: None Aug 03 05:16:41.539384 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: User-Agent: python-urllib3/1.26.10 Aug 03 05:16:41.539384 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Auth-Token: gAAAAABi6gSM887NVNxDyCN3DzJGo9Q2Jk24zwR42xmFiuBWGZL7NE36jZMk_hjfM8IWXs6pab-jD7rzPK-wDlJJ7JQ3zvsssgW6GSlcktRIZCXU4V47d3bdd8z-xmNABntTAKrY8Jh_kHPAHt6S1IoP4RpT7vnNsNFzs_jf9sxc1FsOh_v_iw8 Aug 03 05:16:41.539384 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Domain-Id: None Aug 03 05:16:41.539384 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Domain-Name: None Aug 03 05:16:41.539384 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Identity-Status: Confirmed Aug 03 05:16:41.539384 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Is-Admin-Project: True Aug 03 05:16:41.539384 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Domain-Id: default Aug 03 05:16:41.539384 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Domain-Name: Default Aug 03 05:16:41.539384 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Id: 7a970d4cbb3545a187c75848e10cb166 Aug 03 05:16:41.539384 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Name: tempest-VolumesNegativeTest-1933670163 Aug 03 05:16:41.539384 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Role: member,reader Aug 03 05:16:41.539384 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Roles: member,reader Aug 03 05:16:41.542317 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7a970d4cbb3545a187c75848e10cb166"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7a970d4cbb3545a187c75848e10cb166"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7a970d4cbb3545a187c75848e10cb166"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7a970d4cbb3545a187c75848e10cb166"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:16:41.542317 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant: tempest-VolumesNegativeTest-1933670163 Aug 03 05:16:41.542317 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant-Id: 7a970d4cbb3545a187c75848e10cb166 Aug 03 05:16:41.542317 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant-Name: tempest-VolumesNegativeTest-1933670163 Aug 03 05:16:41.542317 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User: tempest-VolumesNegativeTest-1933670163-project Aug 03 05:16:41.542317 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Domain-Id: default Aug 03 05:16:41.542317 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Domain-Name: Default Aug 03 05:16:41.542317 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Id: ff504c0570b24f3baa8744a9740bcfce Aug 03 05:16:41.542317 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Name: tempest-VolumesNegativeTest-1933670163-project Aug 03 05:16:41.542317 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: method: > Aug 03 05:16:41.542317 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: exception: Instance a21965b8-51d4-4bb6-afb7-053298242bfa could not be found. Aug 03 05:16:41.542317 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: action_args: {'id': 'a21965b8-51d4-4bb6-afb7-053298242bfa'} Aug 03 05:16:41.543664 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:16:41.543664 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:16:41.543664 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:16:41.543664 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:16:41.543664 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:16:41.543664 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:16:41.543664 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:16:41.543664 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:16:41.543664 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:16:41.543664 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:16:41.543664 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a21965b8-51d4-4bb6-afb7-053298242bfa could not be found. Aug 03 05:16:41.543664 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:16:41.543664 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:16:41.543664 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:16:41.543664 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:16:41.543664 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:16:41.543664 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:16:41.543664 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:16:41.543664 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:16:41.543664 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:16:41.546063 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:16:41.546063 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:16:41.546063 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:16:41.546063 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:16:41.546063 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:16:41.546063 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:16:41.546063 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:16:41.546063 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a21965b8-51d4-4bb6-afb7-053298242bfa could not be found. Aug 03 05:16:41.546063 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:16:41.546063 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:16:41.546063 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:16:41.546063 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:16:41.546063 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:16:41.546063 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:16:41.546063 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:16:41.546063 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:16:41.546063 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a21965b8-51d4-4bb6-afb7-053298242bfa could not be found. Aug 03 05:16:41.546063 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:16:41.548292 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-33111c70-e38b-4c2c-829a-c6e9f3b98748 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] Returning 404 to user: Instance a21965b8-51d4-4bb6-afb7-053298242bfa could not be found. {{(pid=118332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:16:41.548292 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-33111c70-e38b-4c2c-829a-c6e9f3b98748 tempest-VolumesNegativeTest-1933670163 tempest-VolumesNegativeTest-1933670163-project] 10.222.0.40 "GET /compute/v2.1/servers/a21965b8-51d4-4bb6-afb7-053298242bfa" status: 404 len: 111 microversion: 2.1 time: 0.032585 Aug 03 05:16:41.548292 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 249/531] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:41 2022] GET /compute/v2.1/servers/a21965b8-51d4-4bb6-afb7-053298242bfa => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:16:41.989267 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-30e3ad9b-bc39-4928-9584-382e28fbe718 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:41.989985 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-30e3ad9b-bc39-4928-9584-382e28fbe718 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] [instance: 363118dd-a0c3-444f-99cb-f0578407e0d2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:41.996829 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-30e3ad9b-bc39-4928-9584-382e28fbe718 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:41.997281 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-30e3ad9b-bc39-4928-9584-382e28fbe718 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:41.998049 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-30e3ad9b-bc39-4928-9584-382e28fbe718 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:41.998493 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-30e3ad9b-bc39-4928-9584-382e28fbe718 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:42.003092 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:16:42.143035 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-30e3ad9b-bc39-4928-9584-382e28fbe718 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79539af2999d48baa11734ced32dccb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d7bf6baa2224b0d910133c5542608e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:42.144941 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-30e3ad9b-bc39-4928-9584-382e28fbe718 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2" status: 200 len: 1595 microversion: 2.1 time: 0.159442 Aug 03 05:16:42.145524 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 283/532] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:41 2022] GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2 => generated 1595 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:44.328327 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [req-f107a9db-77d0-45b8-aa24-b1e3a9e5dab6 req-54521b55-da3a-4aab-9d20-5b8dc2deac0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "363118dd-a0c3-444f-99cb-f0578407e0d2", "tag": "1d2d095e-7779-4335-a8cf-cbd4d15b643b"}]} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:16:44.354493 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-f107a9db-77d0-45b8-aa24-b1e3a9e5dab6 req-54521b55-da3a-4aab-9d20-5b8dc2deac0f service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:44.365872 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-f107a9db-77d0-45b8-aa24-b1e3a9e5dab6 req-54521b55-da3a-4aab-9d20-5b8dc2deac0f service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:44.389276 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.compute.server_external_events [req-f107a9db-77d0-45b8-aa24-b1e3a9e5dab6 req-54521b55-da3a-4aab-9d20-5b8dc2deac0f service nova] Creating event network-changed:1d2d095e-7779-4335-a8cf-cbd4d15b643b for instance 363118dd-a0c3-444f-99cb-f0578407e0d2 on hv-cinder-85127 Aug 03 05:16:44.394441 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [req-f107a9db-77d0-45b8-aa24-b1e3a9e5dab6 req-54521b55-da3a-4aab-9d20-5b8dc2deac0f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069363 Aug 03 05:16:44.394821 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 250/533] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:16:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:16:47.439177 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-e3651bbe-0db4-4d75-8bf8-3e8c225f3d18 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-234787560"}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:16:47.439708 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-e3651bbe-0db4-4d75-8bf8-3e8c225f3d18 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] [instance: 363118dd-a0c3-444f-99cb-f0578407e0d2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:47.446663 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e3651bbe-0db4-4d75-8bf8-3e8c225f3d18 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:47.447153 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e3651bbe-0db4-4d75-8bf8-3e8c225f3d18 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:47.447921 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e3651bbe-0db4-4d75-8bf8-3e8c225f3d18 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:47.448439 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e3651bbe-0db4-4d75-8bf8-3e8c225f3d18 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:47.577356 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.network.security_group_api [None req-e3651bbe-0db4-4d75-8bf8-3e8c225f3d18 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Adding security group 907b5252-778d-4eaf-8628-54cb95c9fffb to port 1d2d095e-7779-4335-a8cf-cbd4d15b643b Aug 03 05:16:47.991736 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-e3651bbe-0db4-4d75-8bf8-3e8c225f3d18 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "POST /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2/action" status: 202 len: 0 microversion: 2.1 time: 0.556496 Aug 03 05:16:47.992461 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 284/534] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Aug 3 05:16:47 2022] POST /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2/action => generated 0 bytes in 558 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:16:48.007835 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-f8fe65d3-baa6-4a99-8b9e-e77e266c14c9 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:48.011921 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [req-de2b0d38-d951-489f-b440-cb325a03d16c req-738b9a9b-4097-49cb-a4ec-2372c8db40e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "363118dd-a0c3-444f-99cb-f0578407e0d2", "tag": "1d2d095e-7779-4335-a8cf-cbd4d15b643b"}]} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:16:48.019671 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-f8fe65d3-baa6-4a99-8b9e-e77e266c14c9 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] [instance: 363118dd-a0c3-444f-99cb-f0578407e0d2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:48.026768 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-de2b0d38-d951-489f-b440-cb325a03d16c req-738b9a9b-4097-49cb-a4ec-2372c8db40e1 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:48.027347 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-de2b0d38-d951-489f-b440-cb325a03d16c req-738b9a9b-4097-49cb-a4ec-2372c8db40e1 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:48.031487 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f8fe65d3-baa6-4a99-8b9e-e77e266c14c9 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:48.035364 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f8fe65d3-baa6-4a99-8b9e-e77e266c14c9 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:48.042349 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f8fe65d3-baa6-4a99-8b9e-e77e266c14c9 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:48.047447 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f8fe65d3-baa6-4a99-8b9e-e77e266c14c9 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:48.052555 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:16:48.055203 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.compute.server_external_events [req-de2b0d38-d951-489f-b440-cb325a03d16c req-738b9a9b-4097-49cb-a4ec-2372c8db40e1 service nova] Creating event network-changed:1d2d095e-7779-4335-a8cf-cbd4d15b643b for instance 363118dd-a0c3-444f-99cb-f0578407e0d2 on hv-cinder-85127 Aug 03 05:16:48.061411 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [req-de2b0d38-d951-489f-b440-cb325a03d16c req-738b9a9b-4097-49cb-a4ec-2372c8db40e1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063810 Aug 03 05:16:48.062305 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 251/535] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:16:48.278417 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-f8fe65d3-baa6-4a99-8b9e-e77e266c14c9 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79539af2999d48baa11734ced32dccb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d7bf6baa2224b0d910133c5542608e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:48.289728 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-f8fe65d3-baa6-4a99-8b9e-e77e266c14c9 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2" status: 200 len: 1760 microversion: 2.1 time: 0.287894 Aug 03 05:16:48.291613 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 285/536] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:48 2022] GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2 => generated 1760 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:48.774297 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-1c00bd34-2c48-4739-8bf6-81458da6f550 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:16:48.777774 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-1c00bd34-2c48-4739-8bf6-81458da6f550 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:48.786040 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-1c00bd34-2c48-4739-8bf6-81458da6f550 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:48.786704 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-1c00bd34-2c48-4739-8bf6-81458da6f550 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:48.787682 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-1c00bd34-2c48-4739-8bf6-81458da6f550 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:48.788314 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-1c00bd34-2c48-4739-8bf6-81458da6f550 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:48.815489 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.objects.instance [None req-1c00bd34-2c48-4739-8bf6-81458da6f550 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lazy-loading 'flavor' on Instance uuid 54dba69b-6ed5-4aff-91cb-3a98e09680d7 {{(pid=118332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:16:49.256085 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-1c00bd34-2c48-4739-8bf6-81458da6f550 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "POST /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7/action" status: 200 len: 32 microversion: 2.1 time: 0.488394 Aug 03 05:16:49.256776 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 252/537] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Aug 3 05:16:48 2022] POST /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7/action => generated 32 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 05:16:49.266629 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-67d7077c-9e58-4e31-86ec-ff880fbe0196 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:49.267341 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-67d7077c-9e58-4e31-86ec-ff880fbe0196 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:49.274251 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-67d7077c-9e58-4e31-86ec-ff880fbe0196 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:49.274787 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-67d7077c-9e58-4e31-86ec-ff880fbe0196 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:49.275697 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-67d7077c-9e58-4e31-86ec-ff880fbe0196 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:49.276146 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-67d7077c-9e58-4e31-86ec-ff880fbe0196 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:49.416196 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-67d7077c-9e58-4e31-86ec-ff880fbe0196 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:49.424923 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-67d7077c-9e58-4e31-86ec-ff880fbe0196 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7" status: 200 len: 1733 microversion: 2.1 time: 0.162331 Aug 03 05:16:49.425495 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 286/538] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:49 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7 => generated 1733 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:16:50.446647 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-59ec0b2c-d892-4c46-a9d5-130c5370f6f0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:50.447375 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-59ec0b2c-d892-4c46-a9d5-130c5370f6f0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:50.455283 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-59ec0b2c-d892-4c46-a9d5-130c5370f6f0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:50.455558 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-59ec0b2c-d892-4c46-a9d5-130c5370f6f0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:50.456347 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-59ec0b2c-d892-4c46-a9d5-130c5370f6f0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:50.456780 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-59ec0b2c-d892-4c46-a9d5-130c5370f6f0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:50.595106 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-59ec0b2c-d892-4c46-a9d5-130c5370f6f0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:50.602944 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-59ec0b2c-d892-4c46-a9d5-130c5370f6f0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7" status: 200 len: 1733 microversion: 2.1 time: 0.160663 Aug 03 05:16:50.603509 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 253/539] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:50 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7 => generated 1733 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:51.624974 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-fe84bed5-91fb-4ce5-9207-a3e52f06f2af tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:51.625590 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-fe84bed5-91fb-4ce5-9207-a3e52f06f2af tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:51.632183 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fe84bed5-91fb-4ce5-9207-a3e52f06f2af tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:51.632640 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fe84bed5-91fb-4ce5-9207-a3e52f06f2af tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:51.633407 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fe84bed5-91fb-4ce5-9207-a3e52f06f2af tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:51.633850 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fe84bed5-91fb-4ce5-9207-a3e52f06f2af tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:51.764091 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-fe84bed5-91fb-4ce5-9207-a3e52f06f2af tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:51.772604 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-fe84bed5-91fb-4ce5-9207-a3e52f06f2af tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7" status: 200 len: 1733 microversion: 2.1 time: 0.151560 Aug 03 05:16:51.773200 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 287/540] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:51 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:52.794221 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-8a3da0d4-fb6a-46e5-816b-b680b0a8ad3e tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:52.794832 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-8a3da0d4-fb6a-46e5-816b-b680b0a8ad3e tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:52.801611 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-8a3da0d4-fb6a-46e5-816b-b680b0a8ad3e tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:52.802096 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-8a3da0d4-fb6a-46e5-816b-b680b0a8ad3e tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:52.802886 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-8a3da0d4-fb6a-46e5-816b-b680b0a8ad3e tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:52.803454 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-8a3da0d4-fb6a-46e5-816b-b680b0a8ad3e tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:52.933803 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-8a3da0d4-fb6a-46e5-816b-b680b0a8ad3e tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:52.941751 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-8a3da0d4-fb6a-46e5-816b-b680b0a8ad3e tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7" status: 200 len: 1733 microversion: 2.1 time: 0.152252 Aug 03 05:16:52.942325 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 254/541] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:52 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:16:53.968357 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-f118a3e5-2f59-474d-9645-30493240b0e6 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:53.968878 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-f118a3e5-2f59-474d-9645-30493240b0e6 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:53.975420 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f118a3e5-2f59-474d-9645-30493240b0e6 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:53.975875 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f118a3e5-2f59-474d-9645-30493240b0e6 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:53.976636 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f118a3e5-2f59-474d-9645-30493240b0e6 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:53.977077 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f118a3e5-2f59-474d-9645-30493240b0e6 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:54.105135 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-f118a3e5-2f59-474d-9645-30493240b0e6 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:54.113022 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-f118a3e5-2f59-474d-9645-30493240b0e6 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7" status: 200 len: 1733 microversion: 2.1 time: 0.149391 Aug 03 05:16:54.113594 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 288/542] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:53 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:55.133550 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-8f8ebe9f-0ff7-4b9f-bc2a-e69eae5163ca tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:55.135843 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-8f8ebe9f-0ff7-4b9f-bc2a-e69eae5163ca tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:55.141376 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-8f8ebe9f-0ff7-4b9f-bc2a-e69eae5163ca tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:55.141831 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-8f8ebe9f-0ff7-4b9f-bc2a-e69eae5163ca tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:55.142595 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-8f8ebe9f-0ff7-4b9f-bc2a-e69eae5163ca tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:55.143079 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-8f8ebe9f-0ff7-4b9f-bc2a-e69eae5163ca tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:55.272610 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-8f8ebe9f-0ff7-4b9f-bc2a-e69eae5163ca tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:55.280557 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-8f8ebe9f-0ff7-4b9f-bc2a-e69eae5163ca tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7" status: 200 len: 1733 microversion: 2.1 time: 0.150803 Aug 03 05:16:55.281122 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 255/543] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:55 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:56.302341 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-ed58eb19-65a3-4427-9e12-dd9fd3d2de95 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:56.303073 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-ed58eb19-65a3-4427-9e12-dd9fd3d2de95 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:56.310657 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ed58eb19-65a3-4427-9e12-dd9fd3d2de95 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:56.311136 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ed58eb19-65a3-4427-9e12-dd9fd3d2de95 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:56.311898 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ed58eb19-65a3-4427-9e12-dd9fd3d2de95 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:56.312334 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ed58eb19-65a3-4427-9e12-dd9fd3d2de95 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:56.444224 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-ed58eb19-65a3-4427-9e12-dd9fd3d2de95 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:56.452695 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-ed58eb19-65a3-4427-9e12-dd9fd3d2de95 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7" status: 200 len: 1733 microversion: 2.1 time: 0.154277 Aug 03 05:16:56.453263 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 289/544] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:56 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:57.473566 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-2e4f7d02-3152-424f-a000-5a4c6cbea9f9 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:57.474181 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-2e4f7d02-3152-424f-a000-5a4c6cbea9f9 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:57.476588 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_api:SELECT=69 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:16:57.481434 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-2e4f7d02-3152-424f-a000-5a4c6cbea9f9 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:57.483139 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-2e4f7d02-3152-424f-a000-5a4c6cbea9f9 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:57.483139 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-2e4f7d02-3152-424f-a000-5a4c6cbea9f9 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:57.483139 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-2e4f7d02-3152-424f-a000-5a4c6cbea9f9 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:57.612979 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-2e4f7d02-3152-424f-a000-5a4c6cbea9f9 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:57.620801 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-2e4f7d02-3152-424f-a000-5a4c6cbea9f9 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7" status: 200 len: 1733 microversion: 2.1 time: 0.151148 Aug 03 05:16:57.621365 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 256/545] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:57 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:58.303891 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-8b2e6d89-cb45-4669-a4e9-cb6afc8386cc tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e860cf0c-c930-41f1-9fe5-44537465ab08", "device": "/dev/sdb"}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:16:58.306942 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-8b2e6d89-cb45-4669-a4e9-cb6afc8386cc tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] [instance: fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:58.313567 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8b2e6d89-cb45-4669-a4e9-cb6afc8386cc tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:58.314016 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8b2e6d89-cb45-4669-a4e9-cb6afc8386cc tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:58.314775 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8b2e6d89-cb45-4669-a4e9-cb6afc8386cc tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:58.315239 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8b2e6d89-cb45-4669-a4e9-cb6afc8386cc tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:58.646321 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-20e692be-9364-4894-929c-7fe0e0fde686 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:58.650704 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-20e692be-9364-4894-929c-7fe0e0fde686 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:58.653518 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-20e692be-9364-4894-929c-7fe0e0fde686 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:58.653983 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-20e692be-9364-4894-929c-7fe0e0fde686 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:58.654812 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-20e692be-9364-4894-929c-7fe0e0fde686 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:58.655240 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-20e692be-9364-4894-929c-7fe0e0fde686 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:58.791561 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-20e692be-9364-4894-929c-7fe0e0fde686 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:58.799712 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-20e692be-9364-4894-929c-7fe0e0fde686 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7" status: 200 len: 1733 microversion: 2.1 time: 0.161539 Aug 03 05:16:58.800289 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 257/546] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:58 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7 => generated 1733 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:16:59.083632 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-8b2e6d89-cb45-4669-a4e9-cb6afc8386cc tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] 10.222.0.40 "POST /compute/v2.1/servers/fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.783476 Aug 03 05:16:59.084315 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 290/547] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Aug 3 05:16:58 2022] POST /compute/v2.1/servers/fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5/os-volume_attachments => generated 194 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:16:59.822738 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-186597ae-14c4-4243-a8bb-a73610494d3b tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:59.823400 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-186597ae-14c4-4243-a8bb-a73610494d3b tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:59.829917 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-186597ae-14c4-4243-a8bb-a73610494d3b tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:59.830370 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-186597ae-14c4-4243-a8bb-a73610494d3b tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:59.831178 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-186597ae-14c4-4243-a8bb-a73610494d3b tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:59.831664 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-186597ae-14c4-4243-a8bb-a73610494d3b tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:59.961860 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-186597ae-14c4-4243-a8bb-a73610494d3b tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:59.970715 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-186597ae-14c4-4243-a8bb-a73610494d3b tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7" status: 200 len: 1733 microversion: 2.1 time: 0.152500 Aug 03 05:16:59.971317 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 258/548] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:59 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:17:00.992895 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-e34a8803-5243-4943-a498-8c6e9e38ea49 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:00.993593 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-e34a8803-5243-4943-a498-8c6e9e38ea49 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:00.999876 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e34a8803-5243-4943-a498-8c6e9e38ea49 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:01.000336 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e34a8803-5243-4943-a498-8c6e9e38ea49 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:01.001103 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e34a8803-5243-4943-a498-8c6e9e38ea49 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:01.001548 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e34a8803-5243-4943-a498-8c6e9e38ea49 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:01.141913 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-e34a8803-5243-4943-a498-8c6e9e38ea49 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:01.149891 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-e34a8803-5243-4943-a498-8c6e9e38ea49 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7" status: 200 len: 1733 microversion: 2.1 time: 0.161696 Aug 03 05:17:01.151067 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 291/549] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:00 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7 => generated 1733 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:17:02.172132 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-e2f50240-faf0-4c6c-a260-d31edf197fd3 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:02.172730 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-e2f50240-faf0-4c6c-a260-d31edf197fd3 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:02.179166 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e2f50240-faf0-4c6c-a260-d31edf197fd3 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:02.179609 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e2f50240-faf0-4c6c-a260-d31edf197fd3 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:02.180375 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e2f50240-faf0-4c6c-a260-d31edf197fd3 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:02.180795 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e2f50240-faf0-4c6c-a260-d31edf197fd3 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:02.312450 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-e2f50240-faf0-4c6c-a260-d31edf197fd3 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:02.320617 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-e2f50240-faf0-4c6c-a260-d31edf197fd3 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7" status: 200 len: 1733 microversion: 2.1 time: 0.152276 Aug 03 05:17:02.321195 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 259/550] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:02 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:17:03.343773 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-995598d4-6786-422c-895e-3c14b9409925 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:03.344474 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-995598d4-6786-422c-895e-3c14b9409925 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:03.351378 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-995598d4-6786-422c-895e-3c14b9409925 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:03.351822 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-995598d4-6786-422c-895e-3c14b9409925 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:03.352593 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-995598d4-6786-422c-895e-3c14b9409925 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:03.353017 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-995598d4-6786-422c-895e-3c14b9409925 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:03.487118 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-995598d4-6786-422c-895e-3c14b9409925 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:03.494942 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-995598d4-6786-422c-895e-3c14b9409925 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7" status: 200 len: 1733 microversion: 2.1 time: 0.156273 Aug 03 05:17:03.496256 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 292/551] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:03 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7 => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:17:04.517012 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-17e9908f-b3a2-44f4-8772-f5ee901865bb tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:04.517623 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-17e9908f-b3a2-44f4-8772-f5ee901865bb tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:04.524258 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-17e9908f-b3a2-44f4-8772-f5ee901865bb tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:04.524714 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-17e9908f-b3a2-44f4-8772-f5ee901865bb tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:04.525496 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-17e9908f-b3a2-44f4-8772-f5ee901865bb tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:04.525923 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-17e9908f-b3a2-44f4-8772-f5ee901865bb tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:04.659884 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-17e9908f-b3a2-44f4-8772-f5ee901865bb tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:04.667917 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-17e9908f-b3a2-44f4-8772-f5ee901865bb tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7" status: 200 len: 1733 microversion: 2.1 time: 0.154797 Aug 03 05:17:04.668533 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 260/552] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:04 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:17:05.688963 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-f565e2e9-1799-41ef-a08e-2e3bb1b64ec5 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:05.689602 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-f565e2e9-1799-41ef-a08e-2e3bb1b64ec5 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:05.692096 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_api:SELECT=36 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:17:05.696929 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f565e2e9-1799-41ef-a08e-2e3bb1b64ec5 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:05.697387 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f565e2e9-1799-41ef-a08e-2e3bb1b64ec5 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:05.698205 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f565e2e9-1799-41ef-a08e-2e3bb1b64ec5 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:05.699166 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f565e2e9-1799-41ef-a08e-2e3bb1b64ec5 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:05.830431 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-f565e2e9-1799-41ef-a08e-2e3bb1b64ec5 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:05.841102 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-f565e2e9-1799-41ef-a08e-2e3bb1b64ec5 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7" status: 200 len: 1733 microversion: 2.1 time: 0.155944 Aug 03 05:17:05.841929 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 293/553] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:05 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:17:06.861991 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-1320be50-28d9-4572-a150-39e4b2622a7e tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:06.862744 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-1320be50-28d9-4572-a150-39e4b2622a7e tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:06.869546 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-1320be50-28d9-4572-a150-39e4b2622a7e tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:06.870004 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-1320be50-28d9-4572-a150-39e4b2622a7e tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:06.870880 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-1320be50-28d9-4572-a150-39e4b2622a7e tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:06.872215 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-1320be50-28d9-4572-a150-39e4b2622a7e tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:07.006227 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-1320be50-28d9-4572-a150-39e4b2622a7e tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:07.014232 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-1320be50-28d9-4572-a150-39e4b2622a7e tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7" status: 200 len: 1733 microversion: 2.1 time: 0.156138 Aug 03 05:17:07.018117 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 261/554] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:06 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:17:08.036174 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-7bbb12df-3d0f-44e0-9c23-f71e52e5497c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:08.036782 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-7bbb12df-3d0f-44e0-9c23-f71e52e5497c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:08.044311 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7bbb12df-3d0f-44e0-9c23-f71e52e5497c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:08.044763 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7bbb12df-3d0f-44e0-9c23-f71e52e5497c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:08.045533 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7bbb12df-3d0f-44e0-9c23-f71e52e5497c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:08.045968 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7bbb12df-3d0f-44e0-9c23-f71e52e5497c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:08.179930 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-7bbb12df-3d0f-44e0-9c23-f71e52e5497c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:08.188801 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-7bbb12df-3d0f-44e0-9c23-f71e52e5497c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7" status: 200 len: 1733 microversion: 2.1 time: 0.156759 Aug 03 05:17:08.189374 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 294/555] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:08 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7 => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:17:09.209359 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-7518e020-8bd1-4046-a8a0-932efed0c414 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:09.209971 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-7518e020-8bd1-4046-a8a0-932efed0c414 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:09.217301 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-7518e020-8bd1-4046-a8a0-932efed0c414 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:09.217756 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-7518e020-8bd1-4046-a8a0-932efed0c414 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:09.218523 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-7518e020-8bd1-4046-a8a0-932efed0c414 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:09.219001 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-7518e020-8bd1-4046-a8a0-932efed0c414 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:09.347546 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-7518e020-8bd1-4046-a8a0-932efed0c414 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:09.355352 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-7518e020-8bd1-4046-a8a0-932efed0c414 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7" status: 200 len: 1733 microversion: 2.1 time: 0.149814 Aug 03 05:17:09.355918 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 262/556] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:09 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:17:10.377147 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-b6e11777-fca9-49eb-bd4f-a45baf297d7f tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:10.377826 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-b6e11777-fca9-49eb-bd4f-a45baf297d7f tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:10.387223 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b6e11777-fca9-49eb-bd4f-a45baf297d7f tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:10.387689 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b6e11777-fca9-49eb-bd4f-a45baf297d7f tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:10.388457 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b6e11777-fca9-49eb-bd4f-a45baf297d7f tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:10.388892 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b6e11777-fca9-49eb-bd4f-a45baf297d7f tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:10.535241 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-b6e11777-fca9-49eb-bd4f-a45baf297d7f tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:10.543267 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-b6e11777-fca9-49eb-bd4f-a45baf297d7f tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7" status: 200 len: 1733 microversion: 2.1 time: 0.170456 Aug 03 05:17:10.543830 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 295/557] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:10 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7 => generated 1733 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:17:11.564864 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-122c7d65-ab43-4657-994d-a48865f11daa tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:11.565442 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-122c7d65-ab43-4657-994d-a48865f11daa tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:11.571960 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-122c7d65-ab43-4657-994d-a48865f11daa tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:11.572418 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-122c7d65-ab43-4657-994d-a48865f11daa tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:11.573789 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-122c7d65-ab43-4657-994d-a48865f11daa tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:11.574231 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-122c7d65-ab43-4657-994d-a48865f11daa tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:11.703342 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-122c7d65-ab43-4657-994d-a48865f11daa tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:11.711431 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-122c7d65-ab43-4657-994d-a48865f11daa tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7" status: 200 len: 1733 microversion: 2.1 time: 0.150591 Aug 03 05:17:11.711996 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 263/558] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:11 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:17:12.733468 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-1a75b0c9-20a9-4456-a134-c1e8ef1fb21e tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:12.734080 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-1a75b0c9-20a9-4456-a134-c1e8ef1fb21e tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:12.740747 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1a75b0c9-20a9-4456-a134-c1e8ef1fb21e tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:12.741198 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1a75b0c9-20a9-4456-a134-c1e8ef1fb21e tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:12.741969 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1a75b0c9-20a9-4456-a134-c1e8ef1fb21e tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:12.742429 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1a75b0c9-20a9-4456-a134-c1e8ef1fb21e tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:12.745529 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:17:12.878744 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-1a75b0c9-20a9-4456-a134-c1e8ef1fb21e tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:12.886583 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-1a75b0c9-20a9-4456-a134-c1e8ef1fb21e tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7" status: 200 len: 1733 microversion: 2.1 time: 0.157043 Aug 03 05:17:12.887186 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 296/559] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:12 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7 => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:17:13.907948 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-e04a9a6e-2e8f-4cfc-8f7d-ccae0c8bbfd2 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:13.908513 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-e04a9a6e-2e8f-4cfc-8f7d-ccae0c8bbfd2 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:13.915100 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e04a9a6e-2e8f-4cfc-8f7d-ccae0c8bbfd2 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:13.915558 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e04a9a6e-2e8f-4cfc-8f7d-ccae0c8bbfd2 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:13.916393 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e04a9a6e-2e8f-4cfc-8f7d-ccae0c8bbfd2 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:13.916819 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e04a9a6e-2e8f-4cfc-8f7d-ccae0c8bbfd2 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:14.046074 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-e04a9a6e-2e8f-4cfc-8f7d-ccae0c8bbfd2 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:14.056019 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-e04a9a6e-2e8f-4cfc-8f7d-ccae0c8bbfd2 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7" status: 200 len: 1733 microversion: 2.1 time: 0.152020 Aug 03 05:17:14.056618 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 264/560] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:13 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:17:15.078866 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-da048995-8f49-4b89-9444-8904150b1df4 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:15.079478 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-da048995-8f49-4b89-9444-8904150b1df4 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:15.086246 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-da048995-8f49-4b89-9444-8904150b1df4 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:15.086695 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-da048995-8f49-4b89-9444-8904150b1df4 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:15.087495 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-da048995-8f49-4b89-9444-8904150b1df4 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:15.087936 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-da048995-8f49-4b89-9444-8904150b1df4 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:15.230259 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-da048995-8f49-4b89-9444-8904150b1df4 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:15.238379 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-da048995-8f49-4b89-9444-8904150b1df4 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7" status: 200 len: 1733 microversion: 2.1 time: 0.163501 Aug 03 05:17:15.238971 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 297/561] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:15 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7 => generated 1733 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:17:16.259085 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-1ad383e5-8e0c-4939-9ecc-a031986cb417 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:16.259698 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-1ad383e5-8e0c-4939-9ecc-a031986cb417 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:16.266106 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-1ad383e5-8e0c-4939-9ecc-a031986cb417 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:16.266562 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-1ad383e5-8e0c-4939-9ecc-a031986cb417 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:16.267363 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-1ad383e5-8e0c-4939-9ecc-a031986cb417 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:16.267804 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-1ad383e5-8e0c-4939-9ecc-a031986cb417 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:16.395503 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-1ad383e5-8e0c-4939-9ecc-a031986cb417 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:16.403669 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-1ad383e5-8e0c-4939-9ecc-a031986cb417 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7" status: 200 len: 1733 microversion: 2.1 time: 0.148516 Aug 03 05:17:16.404247 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 265/562] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:16 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7 => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:17:17.425481 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-bc82e974-482a-4df0-8bdf-bcaff5040ab9 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:17.426095 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-bc82e974-482a-4df0-8bdf-bcaff5040ab9 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:17.433220 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bc82e974-482a-4df0-8bdf-bcaff5040ab9 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:17.433674 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bc82e974-482a-4df0-8bdf-bcaff5040ab9 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:17.434441 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bc82e974-482a-4df0-8bdf-bcaff5040ab9 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:17.434910 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bc82e974-482a-4df0-8bdf-bcaff5040ab9 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:17.565285 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-bc82e974-482a-4df0-8bdf-bcaff5040ab9 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:17.573236 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-bc82e974-482a-4df0-8bdf-bcaff5040ab9 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7" status: 200 len: 1733 microversion: 2.1 time: 0.151732 Aug 03 05:17:17.573804 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 298/563] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:17 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:17:18.595565 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-90d342bb-d117-44b1-ba5a-2d3e6f198418 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:18.596174 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-90d342bb-d117-44b1-ba5a-2d3e6f198418 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:18.602681 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-90d342bb-d117-44b1-ba5a-2d3e6f198418 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:18.603168 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-90d342bb-d117-44b1-ba5a-2d3e6f198418 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:18.603928 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-90d342bb-d117-44b1-ba5a-2d3e6f198418 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:18.604374 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-90d342bb-d117-44b1-ba5a-2d3e6f198418 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:18.621743 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:17:18.738376 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-90d342bb-d117-44b1-ba5a-2d3e6f198418 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:18.746933 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-90d342bb-d117-44b1-ba5a-2d3e6f198418 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7" status: 200 len: 1733 microversion: 2.1 time: 0.155194 Aug 03 05:17:18.747504 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 266/564] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:18 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:17:19.767775 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-9643c277-d54e-44cd-a9c5-698ad7852537 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:19.768389 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-9643c277-d54e-44cd-a9c5-698ad7852537 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:19.774934 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9643c277-d54e-44cd-a9c5-698ad7852537 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:19.775388 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9643c277-d54e-44cd-a9c5-698ad7852537 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:19.776753 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9643c277-d54e-44cd-a9c5-698ad7852537 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:19.777191 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9643c277-d54e-44cd-a9c5-698ad7852537 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:19.904557 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-9643c277-d54e-44cd-a9c5-698ad7852537 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:19.912542 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-9643c277-d54e-44cd-a9c5-698ad7852537 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7" status: 200 len: 1733 microversion: 2.1 time: 0.148550 Aug 03 05:17:19.913121 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 299/565] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:19 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7 => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:17:20.933617 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-392e27b2-c4a6-48fc-bd1c-d20d9d168939 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:20.934131 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-392e27b2-c4a6-48fc-bd1c-d20d9d168939 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:20.940639 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-392e27b2-c4a6-48fc-bd1c-d20d9d168939 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:20.941095 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-392e27b2-c4a6-48fc-bd1c-d20d9d168939 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:20.941862 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-392e27b2-c4a6-48fc-bd1c-d20d9d168939 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:20.942306 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-392e27b2-c4a6-48fc-bd1c-d20d9d168939 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:21.071245 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-392e27b2-c4a6-48fc-bd1c-d20d9d168939 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:21.083026 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-392e27b2-c4a6-48fc-bd1c-d20d9d168939 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7" status: 200 len: 1713 microversion: 2.1 time: 0.153313 Aug 03 05:17:21.083634 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 267/566] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:20 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7 => generated 1713 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:17:21.196832 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-7fe612e7-040e-4794-8cf8-310328836d8b tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:21.197360 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-7fe612e7-040e-4794-8cf8-310328836d8b tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:21.203964 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7fe612e7-040e-4794-8cf8-310328836d8b tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:21.204422 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7fe612e7-040e-4794-8cf8-310328836d8b tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:21.205200 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7fe612e7-040e-4794-8cf8-310328836d8b tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:21.205643 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7fe612e7-040e-4794-8cf8-310328836d8b tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:21.298425 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.wsgi [None req-7fe612e7-040e-4794-8cf8-310328836d8b tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] HTTP exception thrown: Cannot 'detach_volume' instance 54dba69b-6ed5-4aff-91cb-3a98e09680d7 while it is in vm_state rescued Aug 03 05:17:21.300065 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-7fe612e7-040e-4794-8cf8-310328836d8b tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Request method failure captured: Aug 03 05:17:21.300065 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: request: DELETE /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7/os-volume_attachments/2f946b6e-7213-470a-a9a1-0a1110fd5385 HTTP/1.1 Aug 03 05:17:21.300065 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Accept: application/json Aug 03 05:17:21.300065 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Accept-Encoding: identity Aug 03 05:17:21.300065 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Connection: close Aug 03 05:17:21.300065 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Content-Length: 0 Aug 03 05:17:21.300065 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Content-Type: application/json Aug 03 05:17:21.300065 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Host: 10.222.0.40 Aug 03 05:17:21.300065 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Openstack-System-Scope: None Aug 03 05:17:21.300065 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: User-Agent: python-urllib3/1.26.10 Aug 03 05:17:21.300065 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Auth-Token: gAAAAABi6gPTVv1oE_O2DS7JexgjiVZZ5yTvwFfTDvv3fgwnZVMm1QuvOqQPlPZjdlHsUhwyK7cAnIGz147fLocUeEXFYRmV5CkqTfDI-9PO3MxodM9kCsKki6-i9zKuoaKrTaTYSrvfPqxK8YsU3BCLBF7PgTgJHbL8c6JahRaay9047vP40N4 Aug 03 05:17:21.300065 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Domain-Id: None Aug 03 05:17:21.300065 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Domain-Name: None Aug 03 05:17:21.300065 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Identity-Status: Confirmed Aug 03 05:17:21.300065 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Is-Admin-Project: True Aug 03 05:17:21.300065 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Domain-Id: default Aug 03 05:17:21.300065 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Domain-Name: Default Aug 03 05:17:21.300065 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Id: 829c8e80e96d40d682a17185eb4da336 Aug 03 05:17:21.300065 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1128427595 Aug 03 05:17:21.300065 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Role: member,reader Aug 03 05:17:21.300065 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Roles: member,reader Aug 03 05:17:21.301614 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_829c8e80e96d40d682a17185eb4da336"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/829c8e80e96d40d682a17185eb4da336"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/829c8e80e96d40d682a17185eb4da336"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/829c8e80e96d40d682a17185eb4da336"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:17:21.301614 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1128427595 Aug 03 05:17:21.301614 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant-Id: 829c8e80e96d40d682a17185eb4da336 Aug 03 05:17:21.301614 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1128427595 Aug 03 05:17:21.301614 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User: tempest-ServerRescueNegativeTestJSON-1128427595-project Aug 03 05:17:21.301614 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Domain-Id: default Aug 03 05:17:21.301614 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Domain-Name: Default Aug 03 05:17:21.301614 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Id: bb0fe4cb98e0447cad3e126da1a8de9c Aug 03 05:17:21.301614 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1128427595-project Aug 03 05:17:21.301614 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: method: > Aug 03 05:17:21.301614 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: exception: Cannot 'detach_volume' instance 54dba69b-6ed5-4aff-91cb-3a98e09680d7 while it is in vm_state rescued Aug 03 05:17:21.302579 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: action_args: {'server_id': '54dba69b-6ed5-4aff-91cb-3a98e09680d7', 'id': '2f946b6e-7213-470a-a9a1-0a1110fd5385'} Aug 03 05:17:21.302579 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:17:21.302579 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:17:21.302579 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 03 05:17:21.302579 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 03 05:17:21.302579 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 05:17:21.302579 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 05:17:21.302579 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 03 05:17:21.302579 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 03 05:17:21.302579 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 54dba69b-6ed5-4aff-91cb-3a98e09680d7 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 03 05:17:21.302579 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:17:21.302579 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:17:21.302579 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:17:21.302579 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:17:21.302579 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:17:21.302579 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:17:21.302579 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:17:21.302579 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:17:21.302579 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:17:21.302579 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:17:21.304186 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 03 05:17:21.304186 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 03 05:17:21.304186 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 03 05:17:21.304186 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 03 05:17:21.304186 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 54dba69b-6ed5-4aff-91cb-3a98e09680d7 while it is in vm_state rescued Aug 03 05:17:21.304186 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:17:21.304186 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:17:21.304186 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:17:21.304186 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:17:21.304186 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:17:21.304186 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:17:21.304186 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:17:21.304186 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:17:21.304186 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 54dba69b-6ed5-4aff-91cb-3a98e09680d7 while it is in vm_state rescued Aug 03 05:17:21.304186 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:17:21.304186 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-7fe612e7-040e-4794-8cf8-310328836d8b tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Returning 409 to user: Cannot 'detach_volume' instance 54dba69b-6ed5-4aff-91cb-3a98e09680d7 while it is in vm_state rescued {{(pid=118331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:17:21.305454 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-7fe612e7-040e-4794-8cf8-310328836d8b tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "DELETE /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7/os-volume_attachments/2f946b6e-7213-470a-a9a1-0a1110fd5385" status: 409 len: 152 microversion: 2.1 time: 0.108754 Aug 03 05:17:21.305454 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 300/567] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Aug 3 05:17:21 2022] DELETE /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7/os-volume_attachments/2f946b6e-7213-470a-a9a1-0a1110fd5385 => generated 152 bytes in 110 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 03 05:17:21.310264 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-49301fad-37d0-427e-832f-71ab2cd28faf tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:17:21.310794 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-49301fad-37d0-427e-832f-71ab2cd28faf tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:21.316740 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-49301fad-37d0-427e-832f-71ab2cd28faf tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:21.317189 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-49301fad-37d0-427e-832f-71ab2cd28faf tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:21.317938 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-49301fad-37d0-427e-832f-71ab2cd28faf tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:21.318373 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-49301fad-37d0-427e-832f-71ab2cd28faf tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:21.562458 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-49301fad-37d0-427e-832f-71ab2cd28faf tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "POST /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7/action" status: 202 len: 0 microversion: 2.1 time: 0.255777 Aug 03 05:17:21.563171 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 268/568] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Aug 3 05:17:21 2022] POST /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:17:21.571440 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-82760148-79ca-4127-b30b-82b51390e19d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:21.572109 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-82760148-79ca-4127-b30b-82b51390e19d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:21.578999 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-82760148-79ca-4127-b30b-82b51390e19d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:21.579460 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-82760148-79ca-4127-b30b-82b51390e19d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:21.580713 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-82760148-79ca-4127-b30b-82b51390e19d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:21.581203 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-82760148-79ca-4127-b30b-82b51390e19d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:21.714699 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-82760148-79ca-4127-b30b-82b51390e19d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:21.722856 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-82760148-79ca-4127-b30b-82b51390e19d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7" status: 200 len: 1721 microversion: 2.1 time: 0.155344 Aug 03 05:17:21.723436 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 301/569] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:21 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:17:22.744695 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-e905935f-c4a1-4400-9172-8d3e3b130ffd tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:22.745917 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-e905935f-c4a1-4400-9172-8d3e3b130ffd tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:22.752677 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e905935f-c4a1-4400-9172-8d3e3b130ffd tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:22.753131 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e905935f-c4a1-4400-9172-8d3e3b130ffd tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:22.753894 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e905935f-c4a1-4400-9172-8d3e3b130ffd tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:22.754336 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e905935f-c4a1-4400-9172-8d3e3b130ffd tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:22.883389 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-e905935f-c4a1-4400-9172-8d3e3b130ffd tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:22.891920 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-e905935f-c4a1-4400-9172-8d3e3b130ffd tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7" status: 200 len: 1721 microversion: 2.1 time: 0.151569 Aug 03 05:17:22.892499 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 269/570] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:22 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:17:23.913983 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-887f577c-d1d5-4b11-b748-92470a7c48a0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:23.914543 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-887f577c-d1d5-4b11-b748-92470a7c48a0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:23.921010 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-887f577c-d1d5-4b11-b748-92470a7c48a0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:23.921464 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-887f577c-d1d5-4b11-b748-92470a7c48a0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:23.923075 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-887f577c-d1d5-4b11-b748-92470a7c48a0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:23.923075 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-887f577c-d1d5-4b11-b748-92470a7c48a0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:24.054408 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-887f577c-d1d5-4b11-b748-92470a7c48a0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:24.063572 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-887f577c-d1d5-4b11-b748-92470a7c48a0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7" status: 200 len: 1721 microversion: 2.1 time: 0.153634 Aug 03 05:17:24.064129 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 302/571] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:23 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:17:24.789140 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-43e4d479-93e4-4fec-95af-9e928e82e03e tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:24.789639 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-43e4d479-93e4-4fec-95af-9e928e82e03e tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] [instance: fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:24.796880 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-43e4d479-93e4-4fec-95af-9e928e82e03e tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:24.797346 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-43e4d479-93e4-4fec-95af-9e928e82e03e tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:24.798097 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-43e4d479-93e4-4fec-95af-9e928e82e03e tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:24.798536 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-43e4d479-93e4-4fec-95af-9e928e82e03e tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:24.919759 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.objects.instance [None req-43e4d479-93e4-4fec-95af-9e928e82e03e tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lazy-loading 'services' on Instance uuid fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5 {{(pid=118332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:17:25.085934 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-3a295fd4-b592-4d82-a437-c891b5c6b402 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:25.087109 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-3a295fd4-b592-4d82-a437-c891b5c6b402 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:25.094107 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3a295fd4-b592-4d82-a437-c891b5c6b402 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:25.095459 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3a295fd4-b592-4d82-a437-c891b5c6b402 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:25.096421 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3a295fd4-b592-4d82-a437-c891b5c6b402 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:25.096873 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3a295fd4-b592-4d82-a437-c891b5c6b402 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:25.173167 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-43e4d479-93e4-4fec-95af-9e928e82e03e tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] 10.222.0.40 "DELETE /compute/v2.1/servers/fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5/os-volume_attachments/e860cf0c-c930-41f1-9fe5-44537465ab08" status: 202 len: 0 microversion: 2.1 time: 0.387608 Aug 03 05:17:25.176975 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 270/572] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Aug 3 05:17:24 2022] DELETE /compute/v2.1/servers/fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5/os-volume_attachments/e860cf0c-c930-41f1-9fe5-44537465ab08 => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:17:25.237035 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-3a295fd4-b592-4d82-a437-c891b5c6b402 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:25.245336 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-3a295fd4-b592-4d82-a437-c891b5c6b402 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7" status: 200 len: 1721 microversion: 2.1 time: 0.163303 Aug 03 05:17:25.246516 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 303/573] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:25 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:17:26.268458 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-8ba33a5b-2663-4167-887a-ebe994a83f56 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:26.269900 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-8ba33a5b-2663-4167-887a-ebe994a83f56 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:26.276531 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-8ba33a5b-2663-4167-887a-ebe994a83f56 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:26.277082 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-8ba33a5b-2663-4167-887a-ebe994a83f56 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:26.277855 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-8ba33a5b-2663-4167-887a-ebe994a83f56 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:26.278298 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-8ba33a5b-2663-4167-887a-ebe994a83f56 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:26.412539 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-8ba33a5b-2663-4167-887a-ebe994a83f56 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:26.420600 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-8ba33a5b-2663-4167-887a-ebe994a83f56 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7" status: 200 len: 1727 microversion: 2.1 time: 0.156881 Aug 03 05:17:26.421169 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 271/574] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:26 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:17:26.445398 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-f0346b9d-ed6f-4fde-b676-a59ced306d05 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:26.446021 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-f0346b9d-ed6f-4fde-b676-a59ced306d05 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:26.453002 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f0346b9d-ed6f-4fde-b676-a59ced306d05 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:26.453456 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f0346b9d-ed6f-4fde-b676-a59ced306d05 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:26.454236 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f0346b9d-ed6f-4fde-b676-a59ced306d05 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:26.454677 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f0346b9d-ed6f-4fde-b676-a59ced306d05 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:26.531660 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-f0346b9d-ed6f-4fde-b676-a59ced306d05 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090217 Aug 03 05:17:26.532253 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 304/575] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Aug 3 05:17:26 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:17:27.363719 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-d62d63ff-d708-48fe-ad72-71d905d74dfc tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:27.364290 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-d62d63ff-d708-48fe-ad72-71d905d74dfc tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] [instance: fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:27.370741 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-d62d63ff-d708-48fe-ad72-71d905d74dfc tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:27.371237 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-d62d63ff-d708-48fe-ad72-71d905d74dfc tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:27.372021 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-d62d63ff-d708-48fe-ad72-71d905d74dfc tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:27.372462 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-d62d63ff-d708-48fe-ad72-71d905d74dfc tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:27.399156 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-d62d63ff-d708-48fe-ad72-71d905d74dfc tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] [instance: fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5] Going to try to terminate instance {{(pid=118332) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:17:27.615691 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_api:SELECT=34 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:17:27.685020 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-d62d63ff-d708-48fe-ad72-71d905d74dfc tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] 10.222.0.40 "DELETE /compute/v2.1/servers/fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5" status: 204 len: 0 microversion: 2.1 time: 0.324835 Aug 03 05:17:27.685868 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 272/576] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Aug 3 05:17:27 2022] DELETE /compute/v2.1/servers/fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:17:27.692797 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-914f89b3-6917-428d-a4fc-8f412c1cfa95 req-12800e96-8e42-4189-ad56-08691634376e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54dba69b-6ed5-4aff-91cb-3a98e09680d7", "tag": "961b2cd9-c56a-4c39-8446-8f00f4de31f0"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:17:27.695325 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-cd14cc50-b8e9-4c28-a72a-1177c210cb82 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:27.700190 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-cd14cc50-b8e9-4c28-a72a-1177c210cb82 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] [instance: fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:27.705640 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-914f89b3-6917-428d-a4fc-8f412c1cfa95 req-12800e96-8e42-4189-ad56-08691634376e service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:27.706310 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-914f89b3-6917-428d-a4fc-8f412c1cfa95 req-12800e96-8e42-4189-ad56-08691634376e service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:27.706445 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-cd14cc50-b8e9-4c28-a72a-1177c210cb82 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:27.706878 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-cd14cc50-b8e9-4c28-a72a-1177c210cb82 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:27.708038 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-cd14cc50-b8e9-4c28-a72a-1177c210cb82 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:27.708788 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-cd14cc50-b8e9-4c28-a72a-1177c210cb82 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:27.719796 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-914f89b3-6917-428d-a4fc-8f412c1cfa95 req-12800e96-8e42-4189-ad56-08691634376e service nova] Creating event network-changed:961b2cd9-c56a-4c39-8446-8f00f4de31f0 for instance 54dba69b-6ed5-4aff-91cb-3a98e09680d7 on hv-cinder-85127 Aug 03 05:17:27.725401 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-914f89b3-6917-428d-a4fc-8f412c1cfa95 req-12800e96-8e42-4189-ad56-08691634376e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037804 Aug 03 05:17:27.726405 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 305/577] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:17:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:17:27.847425 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-cd14cc50-b8e9-4c28-a72a-1177c210cb82 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7d91983dc4c0fb218e7bdbc1c6558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6675985e19c44dabb624420aaa97b0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:27.854953 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-cd14cc50-b8e9-4c28-a72a-1177c210cb82 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] 10.222.0.40 "GET /compute/v2.1/servers/fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5" status: 200 len: 1514 microversion: 2.1 time: 0.163829 Aug 03 05:17:27.855535 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 273/578] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:27 2022] GET /compute/v2.1/servers/fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5 => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:17:28.877440 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-dad43ac2-b174-4a21-b516-9f8b8baf14b8 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:28.878064 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-dad43ac2-b174-4a21-b516-9f8b8baf14b8 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] [instance: fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:28.884477 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-dad43ac2-b174-4a21-b516-9f8b8baf14b8 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:28.884931 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-dad43ac2-b174-4a21-b516-9f8b8baf14b8 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:28.885707 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-dad43ac2-b174-4a21-b516-9f8b8baf14b8 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:28.886155 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-dad43ac2-b174-4a21-b516-9f8b8baf14b8 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:29.014112 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-dad43ac2-b174-4a21-b516-9f8b8baf14b8 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7d91983dc4c0fb218e7bdbc1c6558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6675985e19c44dabb624420aaa97b0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:29.021618 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-dad43ac2-b174-4a21-b516-9f8b8baf14b8 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] 10.222.0.40 "GET /compute/v2.1/servers/fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5" status: 200 len: 1514 microversion: 2.1 time: 0.148911 Aug 03 05:17:29.022188 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 306/579] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:28 2022] GET /compute/v2.1/servers/fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:17:29.742567 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [req-52ee1e4f-5b4c-4999-879b-e7eec79a4171 req-0ce5902c-3a4b-4b5e-8251-b18f04396b92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54dba69b-6ed5-4aff-91cb-3a98e09680d7", "tag": "961b2cd9-c56a-4c39-8446-8f00f4de31f0"}]} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:17:29.753220 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-52ee1e4f-5b4c-4999-879b-e7eec79a4171 req-0ce5902c-3a4b-4b5e-8251-b18f04396b92 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:29.753675 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-52ee1e4f-5b4c-4999-879b-e7eec79a4171 req-0ce5902c-3a4b-4b5e-8251-b18f04396b92 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:29.766399 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.compute.server_external_events [req-52ee1e4f-5b4c-4999-879b-e7eec79a4171 req-0ce5902c-3a4b-4b5e-8251-b18f04396b92 service nova] Creating event network-changed:961b2cd9-c56a-4c39-8446-8f00f4de31f0 for instance 54dba69b-6ed5-4aff-91cb-3a98e09680d7 on hv-cinder-85127 Aug 03 05:17:29.771366 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [req-52ee1e4f-5b4c-4999-879b-e7eec79a4171 req-0ce5902c-3a4b-4b5e-8251-b18f04396b92 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032648 Aug 03 05:17:29.772292 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 274/580] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:17:30.042567 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-bc4949c6-bf51-4d45-aee0-b1f1cd3377e2 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:30.043541 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-bc4949c6-bf51-4d45-aee0-b1f1cd3377e2 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] [instance: fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:30.052005 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bc4949c6-bf51-4d45-aee0-b1f1cd3377e2 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:30.052447 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bc4949c6-bf51-4d45-aee0-b1f1cd3377e2 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:30.053709 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bc4949c6-bf51-4d45-aee0-b1f1cd3377e2 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:30.053844 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bc4949c6-bf51-4d45-aee0-b1f1cd3377e2 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:30.169158 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-bc4949c6-bf51-4d45-aee0-b1f1cd3377e2 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7d91983dc4c0fb218e7bdbc1c6558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6675985e19c44dabb624420aaa97b0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:30.177011 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-bc4949c6-bf51-4d45-aee0-b1f1cd3377e2 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] 10.222.0.40 "GET /compute/v2.1/servers/fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5" status: 200 len: 1472 microversion: 2.1 time: 0.138330 Aug 03 05:17:30.177584 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 307/581] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:30 2022] GET /compute/v2.1/servers/fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5 => generated 1472 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:17:31.200008 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-b2d26920-6ca7-4a50-98de-cbd7cd609858 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:31.200690 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-b2d26920-6ca7-4a50-98de-cbd7cd609858 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] [instance: fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:31.207096 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b2d26920-6ca7-4a50-98de-cbd7cd609858 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:31.207543 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b2d26920-6ca7-4a50-98de-cbd7cd609858 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:31.208299 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b2d26920-6ca7-4a50-98de-cbd7cd609858 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:31.208734 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b2d26920-6ca7-4a50-98de-cbd7cd609858 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:31.222030 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.wsgi [None req-b2d26920-6ca7-4a50-98de-cbd7cd609858 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] HTTP exception thrown: Instance fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5 could not be found. Aug 03 05:17:31.223669 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-b2d26920-6ca7-4a50-98de-cbd7cd609858 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Request method failure captured: Aug 03 05:17:31.223669 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: request: GET /compute/v2.1/servers/fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5 HTTP/1.1 Aug 03 05:17:31.223669 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Accept: application/json Aug 03 05:17:31.223669 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Accept-Encoding: identity Aug 03 05:17:31.223669 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Connection: close Aug 03 05:17:31.223669 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Content-Length: 0 Aug 03 05:17:31.223669 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Content-Type: application/json Aug 03 05:17:31.223669 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Host: 10.222.0.40 Aug 03 05:17:31.223669 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Openstack-System-Scope: None Aug 03 05:17:31.223669 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: User-Agent: python-urllib3/1.26.10 Aug 03 05:17:31.223669 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Auth-Token: gAAAAABi6gSVZztkmfQERKo06yTN6PPOMjbU0gsHKRG89WJxE-BSkslw8hq86KinrZgfJ9RXeUEOTE8Bxs2OWScOxYV3hMiGIlbWBC41fuosxF0ugKN4Ut25ByJloGXzJJEdGc_yyc2HeSN9umQQHq4P7QZKAK4jLcRD-X0HPXI-q1_6vd9sBCs Aug 03 05:17:31.223669 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Domain-Id: None Aug 03 05:17:31.223669 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Domain-Name: None Aug 03 05:17:31.223669 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Identity-Status: Confirmed Aug 03 05:17:31.223669 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Is-Admin-Project: True Aug 03 05:17:31.223669 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Domain-Id: default Aug 03 05:17:31.223669 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Domain-Name: Default Aug 03 05:17:31.223669 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Id: 6675985e19c44dabb624420aaa97b0f7 Aug 03 05:17:31.223669 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Name: tempest-VolumesSnapshotTestJSON-967457277 Aug 03 05:17:31.223669 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Role: member,reader Aug 03 05:17:31.223669 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Roles: member,reader Aug 03 05:17:31.224981 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6675985e19c44dabb624420aaa97b0f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6675985e19c44dabb624420aaa97b0f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6675985e19c44dabb624420aaa97b0f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6675985e19c44dabb624420aaa97b0f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:17:31.224981 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant: tempest-VolumesSnapshotTestJSON-967457277 Aug 03 05:17:31.224981 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant-Id: 6675985e19c44dabb624420aaa97b0f7 Aug 03 05:17:31.224981 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-967457277 Aug 03 05:17:31.224981 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User: tempest-VolumesSnapshotTestJSON-967457277-project Aug 03 05:17:31.224981 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Domain-Id: default Aug 03 05:17:31.224981 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Domain-Name: Default Aug 03 05:17:31.224981 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Id: 28d7d91983dc4c0fb218e7bdbc1c6558 Aug 03 05:17:31.224981 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Name: tempest-VolumesSnapshotTestJSON-967457277-project Aug 03 05:17:31.224981 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: method: > Aug 03 05:17:31.224981 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: exception: Instance fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5 could not be found. Aug 03 05:17:31.224981 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: action_args: {'id': 'fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5'} Aug 03 05:17:31.225985 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:17:31.225985 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:17:31.225985 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:17:31.225985 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:17:31.225985 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:17:31.225985 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:17:31.225985 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:17:31.225985 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:17:31.225985 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:17:31.225985 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:17:31.225985 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5 could not be found. Aug 03 05:17:31.225985 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:17:31.225985 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:17:31.225985 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:17:31.225985 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:17:31.225985 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:17:31.225985 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:17:31.225985 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:17:31.225985 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:17:31.225985 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:17:31.227569 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:17:31.227569 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:17:31.227569 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:17:31.227569 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:17:31.227569 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:17:31.227569 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:17:31.227569 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:17:31.227569 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5 could not be found. Aug 03 05:17:31.227569 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:17:31.227569 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:17:31.227569 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:17:31.227569 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:17:31.227569 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:17:31.227569 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:17:31.227569 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:17:31.227569 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:17:31.227569 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5 could not be found. Aug 03 05:17:31.227569 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:17:31.229193 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-b2d26920-6ca7-4a50-98de-cbd7cd609858 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Returning 404 to user: Instance fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5 could not be found. {{(pid=118332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:17:31.229193 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-b2d26920-6ca7-4a50-98de-cbd7cd609858 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] 10.222.0.40 "GET /compute/v2.1/servers/fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5" status: 404 len: 111 microversion: 2.1 time: 0.029756 Aug 03 05:17:31.229193 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 275/582] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:31 2022] GET /compute/v2.1/servers/fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:17:31.805571 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-d64dd213-e070-437d-93fc-eb79f686b354 req-ca3cec51-c3dd-4e5c-9a89-4accd74b88ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5", "name": "network-vif-deleted", "tag": "97f8fdc6-81d2-4bf6-91c7-f43776182afd"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:17:31.816311 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-d64dd213-e070-437d-93fc-eb79f686b354 req-ca3cec51-c3dd-4e5c-9a89-4accd74b88ec service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:31.816747 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-d64dd213-e070-437d-93fc-eb79f686b354 req-ca3cec51-c3dd-4e5c-9a89-4accd74b88ec service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:31.827233 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-d64dd213-e070-437d-93fc-eb79f686b354 req-ca3cec51-c3dd-4e5c-9a89-4accd74b88ec service nova] Creating event network-vif-deleted:97f8fdc6-81d2-4bf6-91c7-f43776182afd for instance fdfad105-dd4a-4cfd-8ce3-9ebc2a715cd5 on hv-cinder-85127 Aug 03 05:17:31.831998 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-d64dd213-e070-437d-93fc-eb79f686b354 req-ca3cec51-c3dd-4e5c-9a89-4accd74b88ec service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030005 Aug 03 05:17:31.832468 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 308/583] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:17:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:17:36.829166 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-7156f1b7-8145-4202-aa22-6b154b49614d tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:36.829713 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-7156f1b7-8145-4202-aa22-6b154b49614d tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:36.835971 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-7156f1b7-8145-4202-aa22-6b154b49614d tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:36.836430 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-7156f1b7-8145-4202-aa22-6b154b49614d tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:36.837190 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-7156f1b7-8145-4202-aa22-6b154b49614d tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:36.837901 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-7156f1b7-8145-4202-aa22-6b154b49614d tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:36.867354 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-7156f1b7-8145-4202-aa22-6b154b49614d tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1/os-volume_attachments/a8522739-bacc-493e-9812-f074d1bd34f3" status: 200 len: 194 microversion: 2.20 time: 0.042102 Aug 03 05:17:36.867935 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 276/584] 10.222.0.40 () {60 vars in 1454 bytes} [Wed Aug 3 05:17:36 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1/os-volume_attachments/a8522739-bacc-493e-9812-f074d1bd34f3 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 05:17:36.936098 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-98f99d1b-8f6b-457a-8aff-550bfbbfe420 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:36.936707 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-98f99d1b-8f6b-457a-8aff-550bfbbfe420 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:36.938680 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_api:SELECT=32 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:17:36.943628 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-98f99d1b-8f6b-457a-8aff-550bfbbfe420 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:36.944087 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-98f99d1b-8f6b-457a-8aff-550bfbbfe420 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:36.944855 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-98f99d1b-8f6b-457a-8aff-550bfbbfe420 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:36.945333 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-98f99d1b-8f6b-457a-8aff-550bfbbfe420 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:37.030363 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.objects.instance [None req-98f99d1b-8f6b-457a-8aff-550bfbbfe420 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lazy-loading 'services' on Instance uuid 69089938-1d69-415c-8344-e6b9f78f16d1 {{(pid=118331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:17:37.269230 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-98f99d1b-8f6b-457a-8aff-550bfbbfe420 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "DELETE /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1/os-volume_attachments/a8522739-bacc-493e-9812-f074d1bd34f3" status: 202 len: 0 microversion: 2.20 time: 0.337892 Aug 03 05:17:37.269846 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 309/585] 10.222.0.40 () {60 vars in 1457 bytes} [Wed Aug 3 05:17:36 2022] DELETE /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1/os-volume_attachments/a8522739-bacc-493e-9812-f074d1bd34f3 => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:17:37.280093 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-b959782e-d192-4c29-9f2e-3411ccc20c86 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:37.281769 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-b959782e-d192-4c29-9f2e-3411ccc20c86 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:37.287992 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b959782e-d192-4c29-9f2e-3411ccc20c86 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:37.288491 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b959782e-d192-4c29-9f2e-3411ccc20c86 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:37.289272 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b959782e-d192-4c29-9f2e-3411ccc20c86 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:37.289710 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b959782e-d192-4c29-9f2e-3411ccc20c86 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:37.321608 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-b959782e-d192-4c29-9f2e-3411ccc20c86 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047275 Aug 03 05:17:37.322193 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 277/586] 10.222.0.40 () {60 vars in 1343 bytes} [Wed Aug 3 05:17:37 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 05:17:38.334912 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-d090e587-5536-49aa-9164-5faf44888835 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:38.337521 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-d090e587-5536-49aa-9164-5faf44888835 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:38.343831 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d090e587-5536-49aa-9164-5faf44888835 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:38.344287 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d090e587-5536-49aa-9164-5faf44888835 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:38.345057 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d090e587-5536-49aa-9164-5faf44888835 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:38.345498 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d090e587-5536-49aa-9164-5faf44888835 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:38.374305 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-d090e587-5536-49aa-9164-5faf44888835 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044260 Aug 03 05:17:38.374884 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 310/587] 10.222.0.40 () {60 vars in 1343 bytes} [Wed Aug 3 05:17:38 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 05:17:39.388684 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-bfcfd70e-02bc-4833-80e7-6275d6409e90 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:39.392382 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-bfcfd70e-02bc-4833-80e7-6275d6409e90 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:39.399571 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-bfcfd70e-02bc-4833-80e7-6275d6409e90 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:39.400030 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-bfcfd70e-02bc-4833-80e7-6275d6409e90 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:39.400805 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-bfcfd70e-02bc-4833-80e7-6275d6409e90 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:39.401246 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-bfcfd70e-02bc-4833-80e7-6275d6409e90 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:39.433010 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-bfcfd70e-02bc-4833-80e7-6275d6409e90 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049215 Aug 03 05:17:39.434155 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 278/588] 10.222.0.40 () {60 vars in 1343 bytes} [Wed Aug 3 05:17:39 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 05:17:39.553119 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-263a4d89-aca1-4e9d-bf04-3f38bc62cf19 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:17:39.555266 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-263a4d89-aca1-4e9d-bf04-3f38bc62cf19 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] [instance: 363118dd-a0c3-444f-99cb-f0578407e0d2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:39.562435 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-263a4d89-aca1-4e9d-bf04-3f38bc62cf19 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:39.562917 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-263a4d89-aca1-4e9d-bf04-3f38bc62cf19 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:39.563690 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-263a4d89-aca1-4e9d-bf04-3f38bc62cf19 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:39.564131 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-263a4d89-aca1-4e9d-bf04-3f38bc62cf19 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:39.784198 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-263a4d89-aca1-4e9d-bf04-3f38bc62cf19 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "POST /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2/action" status: 202 len: 0 microversion: 2.1 time: 0.234945 Aug 03 05:17:39.785018 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 311/589] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Aug 3 05:17:39 2022] POST /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:17:39.793997 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-3a154812-0afc-49ee-a75b-2c6a251301fb tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:39.794613 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-3a154812-0afc-49ee-a75b-2c6a251301fb tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] [instance: 363118dd-a0c3-444f-99cb-f0578407e0d2] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:39.800821 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3a154812-0afc-49ee-a75b-2c6a251301fb tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:39.801274 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3a154812-0afc-49ee-a75b-2c6a251301fb tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:39.802042 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3a154812-0afc-49ee-a75b-2c6a251301fb tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:39.802512 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3a154812-0afc-49ee-a75b-2c6a251301fb tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:39.948580 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-3a154812-0afc-49ee-a75b-2c6a251301fb tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79539af2999d48baa11734ced32dccb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d7bf6baa2224b0d910133c5542608e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:39.957429 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-3a154812-0afc-49ee-a75b-2c6a251301fb tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2" status: 200 len: 1752 microversion: 2.1 time: 0.168098 Aug 03 05:17:39.958003 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 279/590] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:39 2022] GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2 => generated 1752 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:17:40.446497 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-00ad5048-cffe-4afb-b8ac-728ff8493f8b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:40.448789 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-00ad5048-cffe-4afb-b8ac-728ff8493f8b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:40.455258 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-00ad5048-cffe-4afb-b8ac-728ff8493f8b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:40.455701 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-00ad5048-cffe-4afb-b8ac-728ff8493f8b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:40.456456 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-00ad5048-cffe-4afb-b8ac-728ff8493f8b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:40.456888 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-00ad5048-cffe-4afb-b8ac-728ff8493f8b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:40.482245 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:17:40.486869 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-00ad5048-cffe-4afb-b8ac-728ff8493f8b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044757 Aug 03 05:17:40.487410 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 312/591] 10.222.0.40 () {60 vars in 1343 bytes} [Wed Aug 3 05:17:40 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 05:17:40.758027 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-b3b6b3bf-573d-424e-8fbc-fac12f2e0eb5 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:40.760966 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-b3b6b3bf-573d-424e-8fbc-fac12f2e0eb5 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:40.767342 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b3b6b3bf-573d-424e-8fbc-fac12f2e0eb5 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:40.767797 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b3b6b3bf-573d-424e-8fbc-fac12f2e0eb5 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:40.768572 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b3b6b3bf-573d-424e-8fbc-fac12f2e0eb5 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:40.769226 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b3b6b3bf-573d-424e-8fbc-fac12f2e0eb5 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:40.798868 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-b3b6b3bf-573d-424e-8fbc-fac12f2e0eb5 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044943 Aug 03 05:17:40.799451 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 280/592] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Aug 3 05:17:40 2022] GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 03 05:17:40.863088 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-ec7a70da-af0a-443c-9742-ab69f3c96f98 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:40.863584 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-ec7a70da-af0a-443c-9742-ab69f3c96f98 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:40.872367 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ec7a70da-af0a-443c-9742-ab69f3c96f98 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:40.875802 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ec7a70da-af0a-443c-9742-ab69f3c96f98 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:40.875802 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ec7a70da-af0a-443c-9742-ab69f3c96f98 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:40.875802 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ec7a70da-af0a-443c-9742-ab69f3c96f98 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:40.905235 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-ec7a70da-af0a-443c-9742-ab69f3c96f98 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Going to try to terminate instance {{(pid=118331) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:17:40.979412 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-7bdc791c-8edd-43bc-98f9-55316fc614c5 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:40.985089 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-7bdc791c-8edd-43bc-98f9-55316fc614c5 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] [instance: 363118dd-a0c3-444f-99cb-f0578407e0d2] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:40.986568 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-7bdc791c-8edd-43bc-98f9-55316fc614c5 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:40.987052 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-7bdc791c-8edd-43bc-98f9-55316fc614c5 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:40.987827 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-7bdc791c-8edd-43bc-98f9-55316fc614c5 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:40.988268 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-7bdc791c-8edd-43bc-98f9-55316fc614c5 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:40.992550 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:17:41.150188 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-7bdc791c-8edd-43bc-98f9-55316fc614c5 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79539af2999d48baa11734ced32dccb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d7bf6baa2224b0d910133c5542608e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:41.159250 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-7bdc791c-8edd-43bc-98f9-55316fc614c5 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2" status: 200 len: 1752 microversion: 2.1 time: 0.183669 Aug 03 05:17:41.162492 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 281/593] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:40 2022] GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2 => generated 1752 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:17:41.218520 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-ec7a70da-af0a-443c-9742-ab69f3c96f98 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "DELETE /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5" status: 204 len: 0 microversion: 2.1 time: 0.358774 Aug 03 05:17:41.219067 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 313/594] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Aug 3 05:17:40 2022] DELETE /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:17:41.227723 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-0b8ce90c-98de-42b6-a0ee-e7da808a17ca tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:41.228349 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-0b8ce90c-98de-42b6-a0ee-e7da808a17ca tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:41.235591 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-0b8ce90c-98de-42b6-a0ee-e7da808a17ca tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:41.237964 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-0b8ce90c-98de-42b6-a0ee-e7da808a17ca tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:41.237964 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-0b8ce90c-98de-42b6-a0ee-e7da808a17ca tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:41.237964 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-0b8ce90c-98de-42b6-a0ee-e7da808a17ca tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:41.373591 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-0b8ce90c-98de-42b6-a0ee-e7da808a17ca tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:41.380994 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-0b8ce90c-98de-42b6-a0ee-e7da808a17ca tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5" status: 200 len: 1673 microversion: 2.1 time: 0.157268 Aug 03 05:17:41.381565 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 282/595] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:41 2022] GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:17:41.500429 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-506a945a-e939-40ef-9edb-8378c0aaa796 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:41.502676 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-506a945a-e939-40ef-9edb-8378c0aaa796 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:41.508839 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-506a945a-e939-40ef-9edb-8378c0aaa796 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:41.509290 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-506a945a-e939-40ef-9edb-8378c0aaa796 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:41.510056 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-506a945a-e939-40ef-9edb-8378c0aaa796 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:41.510495 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-506a945a-e939-40ef-9edb-8378c0aaa796 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:41.538611 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-506a945a-e939-40ef-9edb-8378c0aaa796 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043115 Aug 03 05:17:41.539194 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 314/596] 10.222.0.40 () {60 vars in 1343 bytes} [Wed Aug 3 05:17:41 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:17:41.601049 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-05749f30-f455-4362-800b-bb88b87ab7f2 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:41.601542 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-05749f30-f455-4362-800b-bb88b87ab7f2 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:41.608060 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-05749f30-f455-4362-800b-bb88b87ab7f2 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:41.608513 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-05749f30-f455-4362-800b-bb88b87ab7f2 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:41.609265 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-05749f30-f455-4362-800b-bb88b87ab7f2 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:41.609694 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-05749f30-f455-4362-800b-bb88b87ab7f2 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:41.633826 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-05749f30-f455-4362-800b-bb88b87ab7f2 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Going to try to terminate instance {{(pid=118332) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:17:41.765328 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-e2c685b2-1b60-4227-934e-ac7283fa4e74 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-341697509", "imageRef": "37d7ad4a-d925-48e6-84af-ec878f19050e", "flavorRef": "452", "networks": [{"uuid": "ec3d5553-9ecc-44aa-8db9-0f957032655c"}]}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:17:41.818034 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.network.neutron [None req-e2c685b2-1b60-4227-934e-ac7283fa4e74 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] validate_networks() for [('ec3d5553-9ecc-44aa-8db9-0f957032655c', None, None, None, None, None)] {{(pid=118331) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:17:41.887080 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-05749f30-f455-4362-800b-bb88b87ab7f2 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "DELETE /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 204 len: 0 microversion: 2.20 time: 0.289484 Aug 03 05:17:41.887781 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 283/597] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Aug 3 05:17:41 2022] DELETE /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 05:17:41.896337 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-7f756afc-4afa-44f6-ba97-6853ce9f282b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:41.897120 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-7f756afc-4afa-44f6-ba97-6853ce9f282b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:41.904004 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-7f756afc-4afa-44f6-ba97-6853ce9f282b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:41.904468 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-7f756afc-4afa-44f6-ba97-6853ce9f282b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:41.905252 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-7f756afc-4afa-44f6-ba97-6853ce9f282b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:41.905692 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-7f756afc-4afa-44f6-ba97-6853ce9f282b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:42.132373 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-7f756afc-4afa-44f6-ba97-6853ce9f282b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:42.141910 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-7f756afc-4afa-44f6-ba97-6853ce9f282b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:42.144007 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-7f756afc-4afa-44f6-ba97-6853ce9f282b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:42.145558 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-7f756afc-4afa-44f6-ba97-6853ce9f282b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1721 microversion: 2.20 time: 0.253133 Aug 03 05:17:42.146280 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 284/598] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:17:41 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1721 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 05:17:42.180422 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-02792dba-0617-4257-b2e9-655f0d9661eb tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:42.181039 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-02792dba-0617-4257-b2e9-655f0d9661eb tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] [instance: 363118dd-a0c3-444f-99cb-f0578407e0d2] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:42.187897 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-02792dba-0617-4257-b2e9-655f0d9661eb tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:42.188359 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-02792dba-0617-4257-b2e9-655f0d9661eb tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:42.189158 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-02792dba-0617-4257-b2e9-655f0d9661eb tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:42.189726 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-02792dba-0617-4257-b2e9-655f0d9661eb tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:42.312506 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-e2c685b2-1b60-4227-934e-ac7283fa4e74 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Flavor limits 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:17:42.313007 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-e2c685b2-1b60-4227-934e-ac7283fa4e74 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Image limits 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:17:42.313393 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-e2c685b2-1b60-4227-934e-ac7283fa4e74 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Flavor pref 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:17:42.313805 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-e2c685b2-1b60-4227-934e-ac7283fa4e74 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Image pref 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:17:42.314218 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-e2c685b2-1b60-4227-934e-ac7283fa4e74 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:17:42.322988 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e2c685b2-1b60-4227-934e-ac7283fa4e74 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:42.323436 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e2c685b2-1b60-4227-934e-ac7283fa4e74 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:42.324859 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e2c685b2-1b60-4227-934e-ac7283fa4e74 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:42.325295 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e2c685b2-1b60-4227-934e-ac7283fa4e74 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:42.343462 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-e2c685b2-1b60-4227-934e-ac7283fa4e74 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Getting quotas for project 6675985e19c44dabb624420aaa97b0f7. Resources: {'instances', 'ram', 'cores'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:17:42.348936 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-e2c685b2-1b60-4227-934e-ac7283fa4e74 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Getting quotas for user 28d7d91983dc4c0fb218e7bdbc1c6558 and project 6675985e19c44dabb624420aaa97b0f7. Resources: {'instances', 'ram', 'cores'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:17:42.363918 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-02792dba-0617-4257-b2e9-655f0d9661eb tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79539af2999d48baa11734ced32dccb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d7bf6baa2224b0d910133c5542608e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:42.365254 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-e2c685b2-1b60-4227-934e-ac7283fa4e74 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Going to run 1 instances... {{(pid=118331) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:17:42.369230 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-e2c685b2-1b60-4227-934e-ac7283fa4e74 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] [instance: de47a5df-467d-41d2-ac4a-80d31da9a602] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37d7ad4a-d925-48e6-84af-ec878f19050e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:17:42.372529 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-02792dba-0617-4257-b2e9-655f0d9661eb tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2" status: 200 len: 1752 microversion: 2.1 time: 0.196068 Aug 03 05:17:42.373201 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 285/599] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:42 2022] GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2 => generated 1752 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:17:42.404146 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-b1469418-296d-4e33-a486-d2a822b95cbc tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:42.404771 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-b1469418-296d-4e33-a486-d2a822b95cbc tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:42.413575 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b1469418-296d-4e33-a486-d2a822b95cbc tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:42.414152 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b1469418-296d-4e33-a486-d2a822b95cbc tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:42.414972 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b1469418-296d-4e33-a486-d2a822b95cbc tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:42.415421 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b1469418-296d-4e33-a486-d2a822b95cbc tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:42.543309 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-e2c685b2-1b60-4227-934e-ac7283fa4e74 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.781883 Aug 03 05:17:42.543873 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 315/600] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Aug 3 05:17:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 783 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 05:17:42.551678 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-b1469418-296d-4e33-a486-d2a822b95cbc tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:42.555139 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-b667c65b-9f49-4672-845e-88af234b3fb9 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:42.555763 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-b667c65b-9f49-4672-845e-88af234b3fb9 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] [instance: de47a5df-467d-41d2-ac4a-80d31da9a602] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:42.561825 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-b1469418-296d-4e33-a486-d2a822b95cbc tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5" status: 200 len: 1673 microversion: 2.1 time: 0.162225 Aug 03 05:17:42.562652 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 286/601] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:42 2022] GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 => generated 1673 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:17:42.613846 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-b667c65b-9f49-4672-845e-88af234b3fb9 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7d91983dc4c0fb218e7bdbc1c6558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6675985e19c44dabb624420aaa97b0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:42.622315 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-b667c65b-9f49-4672-845e-88af234b3fb9 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] 10.222.0.40 "GET /compute/v2.1/servers/de47a5df-467d-41d2-ac4a-80d31da9a602" status: 200 len: 1218 microversion: 2.1 time: 0.070562 Aug 03 05:17:42.622976 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 316/602] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:42 2022] GET /compute/v2.1/servers/de47a5df-467d-41d2-ac4a-80d31da9a602 => generated 1218 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:17:43.169508 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-92be9448-e2de-4a95-bfbe-ca1a5b93ca35 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:43.170108 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-92be9448-e2de-4a95-bfbe-ca1a5b93ca35 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:43.176627 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-92be9448-e2de-4a95-bfbe-ca1a5b93ca35 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:43.177067 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-92be9448-e2de-4a95-bfbe-ca1a5b93ca35 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:43.177836 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-92be9448-e2de-4a95-bfbe-ca1a5b93ca35 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:43.178267 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-92be9448-e2de-4a95-bfbe-ca1a5b93ca35 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:43.317183 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-92be9448-e2de-4a95-bfbe-ca1a5b93ca35 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:43.325726 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-92be9448-e2de-4a95-bfbe-ca1a5b93ca35 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:43.327348 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-92be9448-e2de-4a95-bfbe-ca1a5b93ca35 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:43.328575 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-92be9448-e2de-4a95-bfbe-ca1a5b93ca35 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1721 microversion: 2.20 time: 0.163529 Aug 03 05:17:43.329090 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 287/603] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:17:43 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:17:43.393607 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-aac48c62-a327-42f0-a3ec-82dcf5b0ea13 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:43.394269 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-aac48c62-a327-42f0-a3ec-82dcf5b0ea13 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] [instance: 363118dd-a0c3-444f-99cb-f0578407e0d2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:43.401056 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-aac48c62-a327-42f0-a3ec-82dcf5b0ea13 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:43.401729 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-aac48c62-a327-42f0-a3ec-82dcf5b0ea13 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:43.402513 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-aac48c62-a327-42f0-a3ec-82dcf5b0ea13 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:43.403508 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-aac48c62-a327-42f0-a3ec-82dcf5b0ea13 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:43.556283 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-aac48c62-a327-42f0-a3ec-82dcf5b0ea13 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79539af2999d48baa11734ced32dccb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d7bf6baa2224b0d910133c5542608e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:43.564822 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-aac48c62-a327-42f0-a3ec-82dcf5b0ea13 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2" status: 200 len: 1752 microversion: 2.1 time: 0.175126 Aug 03 05:17:43.565399 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 317/604] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:43 2022] GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2 => generated 1752 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:17:43.583929 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-6c0a958c-0af5-4917-881f-7586a327836f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:43.584470 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-6c0a958c-0af5-4917-881f-7586a327836f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:43.590774 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-6c0a958c-0af5-4917-881f-7586a327836f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:43.591268 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-6c0a958c-0af5-4917-881f-7586a327836f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:43.592027 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-6c0a958c-0af5-4917-881f-7586a327836f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:43.592469 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-6c0a958c-0af5-4917-881f-7586a327836f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:43.643380 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-8bef5e55-6278-43c6-be43-ff7a3b2e5001 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:43.644091 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-8bef5e55-6278-43c6-be43-ff7a3b2e5001 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] [instance: de47a5df-467d-41d2-ac4a-80d31da9a602] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:43.650392 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8bef5e55-6278-43c6-be43-ff7a3b2e5001 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:43.650989 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8bef5e55-6278-43c6-be43-ff7a3b2e5001 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:43.651835 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8bef5e55-6278-43c6-be43-ff7a3b2e5001 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:43.652348 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8bef5e55-6278-43c6-be43-ff7a3b2e5001 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:43.728504 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-8bef5e55-6278-43c6-be43-ff7a3b2e5001 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7d91983dc4c0fb218e7bdbc1c6558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6675985e19c44dabb624420aaa97b0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:43.737219 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-8bef5e55-6278-43c6-be43-ff7a3b2e5001 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] 10.222.0.40 "GET /compute/v2.1/servers/de47a5df-467d-41d2-ac4a-80d31da9a602" status: 200 len: 1222 microversion: 2.1 time: 0.097727 Aug 03 05:17:43.737964 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 318/605] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:43 2022] GET /compute/v2.1/servers/de47a5df-467d-41d2-ac4a-80d31da9a602 => generated 1222 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:17:43.752859 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-6c0a958c-0af5-4917-881f-7586a327836f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:43.760447 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-6c0a958c-0af5-4917-881f-7586a327836f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5" status: 200 len: 1673 microversion: 2.1 time: 0.180382 Aug 03 05:17:43.761044 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 288/606] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:43 2022] GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 => generated 1673 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:17:44.352457 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-33ea40c0-9b28-4f3a-b4e9-c8147ae29ca8 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:44.353068 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-33ea40c0-9b28-4f3a-b4e9-c8147ae29ca8 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:44.359727 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-33ea40c0-9b28-4f3a-b4e9-c8147ae29ca8 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:44.360183 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-33ea40c0-9b28-4f3a-b4e9-c8147ae29ca8 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:44.360958 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-33ea40c0-9b28-4f3a-b4e9-c8147ae29ca8 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:44.361396 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-33ea40c0-9b28-4f3a-b4e9-c8147ae29ca8 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:44.490532 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-33ea40c0-9b28-4f3a-b4e9-c8147ae29ca8 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:44.498443 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-33ea40c0-9b28-4f3a-b4e9-c8147ae29ca8 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:44.500014 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-33ea40c0-9b28-4f3a-b4e9-c8147ae29ca8 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:44.501184 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-33ea40c0-9b28-4f3a-b4e9-c8147ae29ca8 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1721 microversion: 2.20 time: 0.152678 Aug 03 05:17:44.501744 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 319/607] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:17:44 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:17:44.586719 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-c531ad3c-550e-430f-b777-c7865b78f38c tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:44.587654 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-c531ad3c-550e-430f-b777-c7865b78f38c tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] [instance: 363118dd-a0c3-444f-99cb-f0578407e0d2] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:44.594744 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-c531ad3c-550e-430f-b777-c7865b78f38c tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:44.595230 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-c531ad3c-550e-430f-b777-c7865b78f38c tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:44.596004 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-c531ad3c-550e-430f-b777-c7865b78f38c tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:44.596448 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-c531ad3c-550e-430f-b777-c7865b78f38c tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:44.744254 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-c531ad3c-550e-430f-b777-c7865b78f38c tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79539af2999d48baa11734ced32dccb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d7bf6baa2224b0d910133c5542608e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:44.752395 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-c531ad3c-550e-430f-b777-c7865b78f38c tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2" status: 200 len: 1757 microversion: 2.1 time: 0.169495 Aug 03 05:17:44.753066 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 289/608] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:44 2022] GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:17:44.757888 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-7923dcec-fe99-45e9-bd5f-8d011c74b782 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:44.758502 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-7923dcec-fe99-45e9-bd5f-8d011c74b782 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] [instance: de47a5df-467d-41d2-ac4a-80d31da9a602] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:44.765040 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7923dcec-fe99-45e9-bd5f-8d011c74b782 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:44.765495 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7923dcec-fe99-45e9-bd5f-8d011c74b782 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:44.766295 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7923dcec-fe99-45e9-bd5f-8d011c74b782 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:44.766714 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7923dcec-fe99-45e9-bd5f-8d011c74b782 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:44.782117 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-d600479f-9a79-40bf-94c7-9b5e852656b3 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:44.782722 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-d600479f-9a79-40bf-94c7-9b5e852656b3 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:44.788677 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-d600479f-9a79-40bf-94c7-9b5e852656b3 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:44.789129 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-d600479f-9a79-40bf-94c7-9b5e852656b3 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:44.789927 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-d600479f-9a79-40bf-94c7-9b5e852656b3 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:44.790371 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-d600479f-9a79-40bf-94c7-9b5e852656b3 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:44.829623 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-7923dcec-fe99-45e9-bd5f-8d011c74b782 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7d91983dc4c0fb218e7bdbc1c6558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6675985e19c44dabb624420aaa97b0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:44.838159 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-7923dcec-fe99-45e9-bd5f-8d011c74b782 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] 10.222.0.40 "GET /compute/v2.1/servers/de47a5df-467d-41d2-ac4a-80d31da9a602" status: 200 len: 1222 microversion: 2.1 time: 0.083975 Aug 03 05:17:44.839111 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 320/609] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:44 2022] GET /compute/v2.1/servers/de47a5df-467d-41d2-ac4a-80d31da9a602 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:17:44.930513 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-d600479f-9a79-40bf-94c7-9b5e852656b3 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:44.938547 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-d600479f-9a79-40bf-94c7-9b5e852656b3 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5" status: 200 len: 1673 microversion: 2.1 time: 0.160957 Aug 03 05:17:44.939150 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 290/610] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:44 2022] GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 => generated 1673 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:17:45.523944 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-192f1729-0993-4307-91e8-9e33ba703f90 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:45.524702 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-192f1729-0993-4307-91e8-9e33ba703f90 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:45.531268 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-192f1729-0993-4307-91e8-9e33ba703f90 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:45.531717 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-192f1729-0993-4307-91e8-9e33ba703f90 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:45.532487 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-192f1729-0993-4307-91e8-9e33ba703f90 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:45.532918 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-192f1729-0993-4307-91e8-9e33ba703f90 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:45.775989 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-9d2a4676-f818-47e7-97c3-128766305cb7 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:45.776621 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-9d2a4676-f818-47e7-97c3-128766305cb7 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] [instance: 363118dd-a0c3-444f-99cb-f0578407e0d2] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:45.786518 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-9d2a4676-f818-47e7-97c3-128766305cb7 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:45.791739 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-9d2a4676-f818-47e7-97c3-128766305cb7 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:45.791739 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-9d2a4676-f818-47e7-97c3-128766305cb7 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:45.791739 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-9d2a4676-f818-47e7-97c3-128766305cb7 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:45.808692 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-192f1729-0993-4307-91e8-9e33ba703f90 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:45.820786 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-192f1729-0993-4307-91e8-9e33ba703f90 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:45.824003 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-192f1729-0993-4307-91e8-9e33ba703f90 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:45.829670 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-192f1729-0993-4307-91e8-9e33ba703f90 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1721 microversion: 2.20 time: 0.307733 Aug 03 05:17:45.835741 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 321/611] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:17:45 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1721 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:17:45.860535 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-ea47f48d-f947-4a5a-94d9-aae65892a87b tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:45.863077 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-ea47f48d-f947-4a5a-94d9-aae65892a87b tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] [instance: de47a5df-467d-41d2-ac4a-80d31da9a602] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:45.869246 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ea47f48d-f947-4a5a-94d9-aae65892a87b tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:45.869696 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ea47f48d-f947-4a5a-94d9-aae65892a87b tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:45.870473 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ea47f48d-f947-4a5a-94d9-aae65892a87b tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:45.870937 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ea47f48d-f947-4a5a-94d9-aae65892a87b tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:45.950870 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-ea47f48d-f947-4a5a-94d9-aae65892a87b tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7d91983dc4c0fb218e7bdbc1c6558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6675985e19c44dabb624420aaa97b0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:45.960920 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-ea47f48d-f947-4a5a-94d9-aae65892a87b tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] 10.222.0.40 "GET /compute/v2.1/servers/de47a5df-467d-41d2-ac4a-80d31da9a602" status: 200 len: 1270 microversion: 2.1 time: 0.104912 Aug 03 05:17:45.971021 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 322/612] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:45 2022] GET /compute/v2.1/servers/de47a5df-467d-41d2-ac4a-80d31da9a602 => generated 1270 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:17:45.976905 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-d6b9b6f6-f79e-45a5-b622-737b988825f7 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:45.978454 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-d6b9b6f6-f79e-45a5-b622-737b988825f7 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:45.985881 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d6b9b6f6-f79e-45a5-b622-737b988825f7 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:45.986741 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d6b9b6f6-f79e-45a5-b622-737b988825f7 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:45.987713 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d6b9b6f6-f79e-45a5-b622-737b988825f7 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:45.988398 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d6b9b6f6-f79e-45a5-b622-737b988825f7 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:46.149940 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-9d2a4676-f818-47e7-97c3-128766305cb7 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79539af2999d48baa11734ced32dccb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d7bf6baa2224b0d910133c5542608e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:46.165056 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-d6b9b6f6-f79e-45a5-b622-737b988825f7 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:46.167828 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-9d2a4676-f818-47e7-97c3-128766305cb7 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2" status: 200 len: 1757 microversion: 2.1 time: 0.396555 Aug 03 05:17:46.173723 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 291/613] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:45 2022] GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2 => generated 1757 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:17:46.180490 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-d6b9b6f6-f79e-45a5-b622-737b988825f7 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5" status: 200 len: 1606 microversion: 2.1 time: 0.207793 Aug 03 05:17:46.183875 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 323/614] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:45 2022] GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 => generated 1606 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:17:46.224151 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [req-ab9a88ec-4816-4d53-b3d0-d3fc3a5b28bf req-81eae00d-c06a-4c28-82ff-c5be63444dfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65fc13ab-3930-4958-8f59-759ba1d047b5", "name": "network-vif-deleted", "tag": "91c4fc09-87e2-45f6-8784-da65f4ce9033"}]} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:17:46.238251 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-ab9a88ec-4816-4d53-b3d0-d3fc3a5b28bf req-81eae00d-c06a-4c28-82ff-c5be63444dfe service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:46.238700 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-ab9a88ec-4816-4d53-b3d0-d3fc3a5b28bf req-81eae00d-c06a-4c28-82ff-c5be63444dfe service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:46.267863 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.compute.server_external_events [req-ab9a88ec-4816-4d53-b3d0-d3fc3a5b28bf req-81eae00d-c06a-4c28-82ff-c5be63444dfe service nova] Creating event network-vif-deleted:91c4fc09-87e2-45f6-8784-da65f4ce9033 for instance 65fc13ab-3930-4958-8f59-759ba1d047b5 on hv-cinder-85127 Aug 03 05:17:46.273159 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [req-ab9a88ec-4816-4d53-b3d0-d3fc3a5b28bf req-81eae00d-c06a-4c28-82ff-c5be63444dfe service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052611 Aug 03 05:17:46.274196 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 292/615] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:17:46.749840 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-0a9cfbad-c088-42dd-b3e4-1fe2dedadd7f req-d6fdba6a-655d-4a9b-a589-9f78def27055 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69089938-1d69-415c-8344-e6b9f78f16d1", "name": "network-vif-deleted", "tag": "602350b3-725c-4735-99e8-acb9b77192fa"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:17:46.771237 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-0a9cfbad-c088-42dd-b3e4-1fe2dedadd7f req-d6fdba6a-655d-4a9b-a589-9f78def27055 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:46.771923 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-0a9cfbad-c088-42dd-b3e4-1fe2dedadd7f req-d6fdba6a-655d-4a9b-a589-9f78def27055 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:46.802159 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-0a9cfbad-c088-42dd-b3e4-1fe2dedadd7f req-d6fdba6a-655d-4a9b-a589-9f78def27055 service nova] Creating event network-vif-deleted:602350b3-725c-4735-99e8-acb9b77192fa for instance 69089938-1d69-415c-8344-e6b9f78f16d1 on hv-cinder-85127 Aug 03 05:17:46.812234 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-0a9cfbad-c088-42dd-b3e4-1fe2dedadd7f req-d6fdba6a-655d-4a9b-a589-9f78def27055 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066151 Aug 03 05:17:46.815096 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 324/616] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:17:46.858086 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-d67605e0-3cac-4fc9-aacd-5030508346cd tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:46.858789 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-d67605e0-3cac-4fc9-aacd-5030508346cd tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:46.869276 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-d67605e0-3cac-4fc9-aacd-5030508346cd tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:46.871037 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-d67605e0-3cac-4fc9-aacd-5030508346cd tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:46.871037 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-d67605e0-3cac-4fc9-aacd-5030508346cd tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:46.871701 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-d67605e0-3cac-4fc9-aacd-5030508346cd tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:46.971866 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-d67605e0-3cac-4fc9-aacd-5030508346cd tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:46.982399 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-d67605e0-3cac-4fc9-aacd-5030508346cd tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:46.984240 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-d67605e0-3cac-4fc9-aacd-5030508346cd tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:46.984804 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-c54b0370-4312-4c6f-a7cc-9b95e6171749 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:46.986061 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-d67605e0-3cac-4fc9-aacd-5030508346cd tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 200 len: 1654 microversion: 2.20 time: 0.133051 Aug 03 05:17:46.986208 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-c54b0370-4312-4c6f-a7cc-9b95e6171749 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] [instance: de47a5df-467d-41d2-ac4a-80d31da9a602] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:46.996453 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 293/617] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:17:46 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 1654 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:17:47.005339 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c54b0370-4312-4c6f-a7cc-9b95e6171749 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:47.005844 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c54b0370-4312-4c6f-a7cc-9b95e6171749 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:47.006904 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c54b0370-4312-4c6f-a7cc-9b95e6171749 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:47.008050 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c54b0370-4312-4c6f-a7cc-9b95e6171749 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:47.103808 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-c54b0370-4312-4c6f-a7cc-9b95e6171749 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7d91983dc4c0fb218e7bdbc1c6558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6675985e19c44dabb624420aaa97b0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:47.115098 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-c54b0370-4312-4c6f-a7cc-9b95e6171749 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] 10.222.0.40 "GET /compute/v2.1/servers/de47a5df-467d-41d2-ac4a-80d31da9a602" status: 200 len: 1276 microversion: 2.1 time: 0.135332 Aug 03 05:17:47.118449 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 325/618] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:46 2022] GET /compute/v2.1/servers/de47a5df-467d-41d2-ac4a-80d31da9a602 => generated 1276 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:17:47.197801 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-fdc3814b-415e-455c-87e0-168b86cb8b06 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:47.197801 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-fdc3814b-415e-455c-87e0-168b86cb8b06 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] [instance: 363118dd-a0c3-444f-99cb-f0578407e0d2] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:47.208232 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-fdc3814b-415e-455c-87e0-168b86cb8b06 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:47.208706 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-fdc3814b-415e-455c-87e0-168b86cb8b06 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:47.209216 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-bad99147-fb15-4f63-a773-38ebbade632e tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:47.210061 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-bad99147-fb15-4f63-a773-38ebbade632e tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:47.212628 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-fdc3814b-415e-455c-87e0-168b86cb8b06 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:47.213109 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-fdc3814b-415e-455c-87e0-168b86cb8b06 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:47.221062 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bad99147-fb15-4f63-a773-38ebbade632e tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:47.222868 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bad99147-fb15-4f63-a773-38ebbade632e tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:47.222868 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bad99147-fb15-4f63-a773-38ebbade632e tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:47.223488 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bad99147-fb15-4f63-a773-38ebbade632e tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:47.269982 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bad99147-fb15-4f63-a773-38ebbade632e tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:47.270796 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bad99147-fb15-4f63-a773-38ebbade632e tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:47.271870 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.objects.instance [None req-bad99147-fb15-4f63-a773-38ebbade632e tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lazy-loading 'fault' on Instance uuid 65fc13ab-3930-4958-8f59-759ba1d047b5 {{(pid=118331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:17:47.378739 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-bad99147-fb15-4f63-a773-38ebbade632e tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:47.390356 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-bad99147-fb15-4f63-a773-38ebbade632e tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5" status: 200 len: 1327 microversion: 2.1 time: 0.186480 Aug 03 05:17:47.391266 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 326/619] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:47 2022] GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 => generated 1327 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:17:47.522511 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-fdc3814b-415e-455c-87e0-168b86cb8b06 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79539af2999d48baa11734ced32dccb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d7bf6baa2224b0d910133c5542608e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:47.533146 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-fdc3814b-415e-455c-87e0-168b86cb8b06 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2" status: 200 len: 1757 microversion: 2.1 time: 0.345595 Aug 03 05:17:47.533742 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 294/620] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:47 2022] GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2 => generated 1757 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:17:48.009798 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-af2ce674-d797-4f3e-bd3a-be7cf61b854c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:48.011363 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-af2ce674-d797-4f3e-bd3a-be7cf61b854c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:48.020423 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-af2ce674-d797-4f3e-bd3a-be7cf61b854c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:48.021188 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-af2ce674-d797-4f3e-bd3a-be7cf61b854c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:48.022280 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-af2ce674-d797-4f3e-bd3a-be7cf61b854c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:48.023050 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-af2ce674-d797-4f3e-bd3a-be7cf61b854c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:48.042024 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.wsgi [None req-af2ce674-d797-4f3e-bd3a-be7cf61b854c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] HTTP exception thrown: Instance 69089938-1d69-415c-8344-e6b9f78f16d1 could not be found. Aug 03 05:17:48.042901 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-af2ce674-d797-4f3e-bd3a-be7cf61b854c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Request method failure captured: Aug 03 05:17:48.042901 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: request: GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 HTTP/1.1 Aug 03 05:17:48.042901 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Accept: application/json Aug 03 05:17:48.042901 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Accept-Encoding: identity Aug 03 05:17:48.042901 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Connection: close Aug 03 05:17:48.042901 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Content-Length: 0 Aug 03 05:17:48.042901 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Content-Type: application/json Aug 03 05:17:48.042901 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Host: 10.222.0.40 Aug 03 05:17:48.042901 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Openstack-System-Scope: None Aug 03 05:17:48.042901 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: User-Agent: python-urllib3/1.26.10 Aug 03 05:17:48.042901 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Auth-Token: gAAAAABi6gPbNCCvHfrbanto4bj1-lel-2VikktM-wW8855hJ86FrqAD7dSHgfAHYeFZxZnlV85Hxb3VVAU_Fz2yzsJnIPiZHqm-1gOuzu_zWyJ2QCRYvy3NiidX8bl9ItEXjqMcGZQGLufjsSKHq1smtGRJyvYnd1iFXLObvq9wAij2WbeQdeU Aug 03 05:17:48.042901 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Domain-Id: None Aug 03 05:17:48.042901 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Domain-Name: None Aug 03 05:17:48.042901 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Identity-Status: Confirmed Aug 03 05:17:48.042901 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Is-Admin-Project: True Aug 03 05:17:48.042901 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Openstack-Nova-Api-Version: 2.20 Aug 03 05:17:48.042901 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Domain-Id: default Aug 03 05:17:48.042901 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Domain-Name: Default Aug 03 05:17:48.042901 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Id: 050592077e0b4d26a1555d2daa7f460d Aug 03 05:17:48.042901 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1717649029 Aug 03 05:17:48.042901 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Role: member,reader Aug 03 05:17:48.042901 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Roles: member,reader Aug 03 05:17:48.045303 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_050592077e0b4d26a1555d2daa7f460d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/050592077e0b4d26a1555d2daa7f460d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/050592077e0b4d26a1555d2daa7f460d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/050592077e0b4d26a1555d2daa7f460d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:17:48.045303 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1717649029 Aug 03 05:17:48.045303 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant-Id: 050592077e0b4d26a1555d2daa7f460d Aug 03 05:17:48.045303 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1717649029 Aug 03 05:17:48.045303 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User: tempest-AttachVolumeShelveTestJSON-1717649029-project Aug 03 05:17:48.045303 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Domain-Id: default Aug 03 05:17:48.045303 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Domain-Name: Default Aug 03 05:17:48.045303 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Id: 747a608061504d7693f0f99ecdfa476e Aug 03 05:17:48.045303 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1717649029-project Aug 03 05:17:48.045303 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: method: > Aug 03 05:17:48.045303 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: exception: Instance 69089938-1d69-415c-8344-e6b9f78f16d1 could not be found. Aug 03 05:17:48.045303 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: action_args: {'id': '69089938-1d69-415c-8344-e6b9f78f16d1'} Aug 03 05:17:48.046307 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:17:48.046307 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:17:48.046307 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:17:48.046307 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:17:48.046307 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:17:48.046307 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:17:48.046307 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:17:48.046307 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:17:48.046307 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:17:48.046307 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:17:48.046307 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69089938-1d69-415c-8344-e6b9f78f16d1 could not be found. Aug 03 05:17:48.046307 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:17:48.046307 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:17:48.046307 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:17:48.046307 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:17:48.046307 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:17:48.046307 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:17:48.046307 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:17:48.046307 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:17:48.046307 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:17:48.047839 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:17:48.047839 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:17:48.047839 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:17:48.047839 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:17:48.047839 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:17:48.047839 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:17:48.047839 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:17:48.047839 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69089938-1d69-415c-8344-e6b9f78f16d1 could not be found. Aug 03 05:17:48.047839 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:17:48.047839 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:17:48.047839 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:17:48.047839 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:17:48.047839 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:17:48.047839 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:17:48.047839 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:17:48.047839 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:17:48.047839 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69089938-1d69-415c-8344-e6b9f78f16d1 could not be found. Aug 03 05:17:48.047839 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:17:48.049826 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-af2ce674-d797-4f3e-bd3a-be7cf61b854c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Returning 404 to user: Instance 69089938-1d69-415c-8344-e6b9f78f16d1 could not be found. {{(pid=118331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:17:48.050768 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-af2ce674-d797-4f3e-bd3a-be7cf61b854c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 404 len: 111 microversion: 2.20 time: 0.045034 Aug 03 05:17:48.054808 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 327/621] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:17:48 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 05:17:48.059685 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-f19816c3-dfa3-4581-b9ca-fe4c2f19870c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '.version_select at 0x7f7603d89790>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:48.141409 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-cdeb01ee-1be0-4af4-a444-c9697276aa03 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:48.142552 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-cdeb01ee-1be0-4af4-a444-c9697276aa03 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] [instance: de47a5df-467d-41d2-ac4a-80d31da9a602] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:48.148847 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-cdeb01ee-1be0-4af4-a444-c9697276aa03 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:48.149480 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-cdeb01ee-1be0-4af4-a444-c9697276aa03 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:48.150416 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-cdeb01ee-1be0-4af4-a444-c9697276aa03 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:48.151044 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-cdeb01ee-1be0-4af4-a444-c9697276aa03 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:48.157267 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-f19816c3-dfa3-4581-b9ca-fe4c2f19870c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-569832163" status: 204 len: 0 microversion: 2.20 time: 0.101311 Aug 03 05:17:48.162947 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 295/622] 10.222.0.40 () {60 vars in 1259 bytes} [Wed Aug 3 05:17:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-569832163 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 05:17:48.417480 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-b63c0216-ad45-494f-a4d1-3a31cfab4dfc tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:48.418589 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-b63c0216-ad45-494f-a4d1-3a31cfab4dfc tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:48.422279 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-cdeb01ee-1be0-4af4-a444-c9697276aa03 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7d91983dc4c0fb218e7bdbc1c6558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6675985e19c44dabb624420aaa97b0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:48.429495 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b63c0216-ad45-494f-a4d1-3a31cfab4dfc tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:48.430217 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b63c0216-ad45-494f-a4d1-3a31cfab4dfc tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:48.431908 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b63c0216-ad45-494f-a4d1-3a31cfab4dfc tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:48.433048 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b63c0216-ad45-494f-a4d1-3a31cfab4dfc tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:48.445039 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-cdeb01ee-1be0-4af4-a444-c9697276aa03 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] 10.222.0.40 "GET /compute/v2.1/servers/de47a5df-467d-41d2-ac4a-80d31da9a602" status: 200 len: 1318 microversion: 2.1 time: 0.305593 Aug 03 05:17:48.449831 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 328/623] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:48 2022] GET /compute/v2.1/servers/de47a5df-467d-41d2-ac4a-80d31da9a602 => generated 1318 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:17:48.460251 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.wsgi [None req-b63c0216-ad45-494f-a4d1-3a31cfab4dfc tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] HTTP exception thrown: Instance 65fc13ab-3930-4958-8f59-759ba1d047b5 could not be found. Aug 03 05:17:48.462453 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-b63c0216-ad45-494f-a4d1-3a31cfab4dfc tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Request method failure captured: Aug 03 05:17:48.462453 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: request: GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 HTTP/1.1 Aug 03 05:17:48.462453 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Accept: application/json Aug 03 05:17:48.462453 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Accept-Encoding: identity Aug 03 05:17:48.462453 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Connection: close Aug 03 05:17:48.462453 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Content-Length: 0 Aug 03 05:17:48.462453 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Content-Type: application/json Aug 03 05:17:48.462453 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Host: 10.222.0.40 Aug 03 05:17:48.462453 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Openstack-System-Scope: None Aug 03 05:17:48.462453 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: User-Agent: python-urllib3/1.26.10 Aug 03 05:17:48.462453 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Auth-Token: gAAAAABi6gPfEYWmbBjRTCK0CUzBUvoIT1d12R6hM-5W5QKad94EcPrIuWEjzTWcdaoDev20Cjg5zI_jw18KOj7aoqrve4p1CjNeo82L37J1_7mc-_oPeqPMuwknK_3IKe4uqnCHfGy1Z4Z_S5S6r9xstkEas5zsjC0rxYdGYTaNfxf5rdAx4U0 Aug 03 05:17:48.462453 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Domain-Id: None Aug 03 05:17:48.462453 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Domain-Name: None Aug 03 05:17:48.462453 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Identity-Status: Confirmed Aug 03 05:17:48.462453 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Is-Admin-Project: True Aug 03 05:17:48.462453 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Domain-Id: default Aug 03 05:17:48.462453 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Domain-Name: Default Aug 03 05:17:48.462453 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Id: 2e1ed25abd8e43009dd8f3f4b7ec1864 Aug 03 05:17:48.462453 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Name: tempest-AttachVolumeTestJSON-331802604 Aug 03 05:17:48.462453 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Role: member,reader Aug 03 05:17:48.462453 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Roles: member,reader Aug 03 05:17:48.464287 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2e1ed25abd8e43009dd8f3f4b7ec1864"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2e1ed25abd8e43009dd8f3f4b7ec1864"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2e1ed25abd8e43009dd8f3f4b7ec1864"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2e1ed25abd8e43009dd8f3f4b7ec1864"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:17:48.464287 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant: tempest-AttachVolumeTestJSON-331802604 Aug 03 05:17:48.464287 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant-Id: 2e1ed25abd8e43009dd8f3f4b7ec1864 Aug 03 05:17:48.464287 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant-Name: tempest-AttachVolumeTestJSON-331802604 Aug 03 05:17:48.464287 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User: tempest-AttachVolumeTestJSON-331802604-project Aug 03 05:17:48.464287 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Domain-Id: default Aug 03 05:17:48.464287 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Domain-Name: Default Aug 03 05:17:48.464287 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Id: f01737ba3200470c8635f335d0338ac8 Aug 03 05:17:48.464287 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Name: tempest-AttachVolumeTestJSON-331802604-project Aug 03 05:17:48.464287 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: method: > Aug 03 05:17:48.464287 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: exception: Instance 65fc13ab-3930-4958-8f59-759ba1d047b5 could not be found. Aug 03 05:17:48.464287 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: action_args: {'id': '65fc13ab-3930-4958-8f59-759ba1d047b5'} Aug 03 05:17:48.465759 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:17:48.465759 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:17:48.465759 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:17:48.465759 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:17:48.465759 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:17:48.465759 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:17:48.465759 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:17:48.465759 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:17:48.465759 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:17:48.465759 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:17:48.465759 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65fc13ab-3930-4958-8f59-759ba1d047b5 could not be found. Aug 03 05:17:48.465759 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:17:48.465759 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:17:48.465759 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:17:48.465759 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:17:48.465759 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:17:48.465759 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:17:48.465759 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:17:48.465759 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:17:48.465759 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:17:48.466936 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:17:48.466936 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:17:48.466936 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:17:48.466936 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:17:48.466936 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:17:48.466936 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:17:48.466936 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:17:48.466936 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65fc13ab-3930-4958-8f59-759ba1d047b5 could not be found. Aug 03 05:17:48.466936 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:17:48.466936 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:17:48.466936 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:17:48.466936 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:17:48.466936 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:17:48.466936 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:17:48.466936 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:17:48.466936 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:17:48.466936 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65fc13ab-3930-4958-8f59-759ba1d047b5 could not be found. Aug 03 05:17:48.466936 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:17:48.467988 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-b63c0216-ad45-494f-a4d1-3a31cfab4dfc tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Returning 404 to user: Instance 65fc13ab-3930-4958-8f59-759ba1d047b5 could not be found. {{(pid=118332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:17:48.467988 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-b63c0216-ad45-494f-a4d1-3a31cfab4dfc tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5" status: 404 len: 111 microversion: 2.1 time: 0.051275 Aug 03 05:17:48.468561 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 296/624] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:48 2022] GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 05:17:48.473917 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-61ef28ca-5317-4a9d-a7be-b435923e0662 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '.version_select at 0x7f7601e98790>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:48.548085 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-61ef28ca-5317-4a9d-a7be-b435923e0662 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-575887889" status: 202 len: 0 microversion: 2.1 time: 0.077472 Aug 03 05:17:48.550093 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 329/625] 10.222.0.40 () {58 vars in 1218 bytes} [Wed Aug 3 05:17:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-575887889 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:17:48.554582 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-22d816fc-718f-4d85-aba9-57fc063eda13 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:48.555239 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-22d816fc-718f-4d85-aba9-57fc063eda13 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] [instance: 363118dd-a0c3-444f-99cb-f0578407e0d2] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:48.561297 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-22d816fc-718f-4d85-aba9-57fc063eda13 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:48.561752 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-22d816fc-718f-4d85-aba9-57fc063eda13 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:48.562529 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-22d816fc-718f-4d85-aba9-57fc063eda13 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:48.563030 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-22d816fc-718f-4d85-aba9-57fc063eda13 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:48.834452 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-22d816fc-718f-4d85-aba9-57fc063eda13 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79539af2999d48baa11734ced32dccb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d7bf6baa2224b0d910133c5542608e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:48.848172 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-22d816fc-718f-4d85-aba9-57fc063eda13 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2" status: 200 len: 1757 microversion: 2.1 time: 0.297421 Aug 03 05:17:48.848770 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 297/626] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:48 2022] GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2 => generated 1757 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:17:49.044857 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-3b5bcc51-da28-4cd4-82a1-fb90b9446ba7 req-5fda5ab0-ffa0-46e7-bb52-08f11e0b7c3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de47a5df-467d-41d2-ac4a-80d31da9a602", "tag": "1b3364e7-57bb-4ce8-a503-12f0787c7875"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:17:49.062513 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-3b5bcc51-da28-4cd4-82a1-fb90b9446ba7 req-5fda5ab0-ffa0-46e7-bb52-08f11e0b7c3d service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:49.063892 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-3b5bcc51-da28-4cd4-82a1-fb90b9446ba7 req-5fda5ab0-ffa0-46e7-bb52-08f11e0b7c3d service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:49.081417 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-3b5bcc51-da28-4cd4-82a1-fb90b9446ba7 req-5fda5ab0-ffa0-46e7-bb52-08f11e0b7c3d service nova] Creating event network-changed:1b3364e7-57bb-4ce8-a503-12f0787c7875 for instance de47a5df-467d-41d2-ac4a-80d31da9a602 on hv-cinder-85127 Aug 03 05:17:49.088142 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-3b5bcc51-da28-4cd4-82a1-fb90b9446ba7 req-5fda5ab0-ffa0-46e7-bb52-08f11e0b7c3d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047954 Aug 03 05:17:49.095379 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 330/627] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:17:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:17:49.135424 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-d6b0e9e3-6c0d-4f30-ab16-be2000ec6e3d tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Action: 'create', calling method: .version_select at 0x7f76020c89d0>, body: {"keypair": {"name": "tempest-keypair-1230351880", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxU4uRuBAJHTe9mBx6cQbBb1y8O7eNhyJcEKlfYJ5Gq/AYsO5LnHxrQxy37cIq5Q7PHilfddgbVwr3++vsEToL1S2u3WEyyy5WvGe3R9x49O0QhH4mxhpy3xdsJ05CWNQ=="}} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:17:49.154736 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.quota [None req-d6b0e9e3-6c0d-4f30-ab16-be2000ec6e3d tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Getting quotas for project 050592077e0b4d26a1555d2daa7f460d. Resources: {'key_pairs'} {{(pid=118332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:17:49.160310 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.quota [None req-d6b0e9e3-6c0d-4f30-ab16-be2000ec6e3d tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Getting quotas for user 747a608061504d7693f0f99ecdfa476e and project 050592077e0b4d26a1555d2daa7f460d. Resources: {'key_pairs'} {{(pid=118332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:17:49.245230 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-d6b0e9e3-6c0d-4f30-ab16-be2000ec6e3d tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.115527 Aug 03 05:17:49.245845 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 298/628] 10.222.0.40 () {62 vars in 1200 bytes} [Wed Aug 3 05:17:49 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 117 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 03 05:17:49.465318 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-30f77816-f9ef-425a-9870-49cd357d8cb7 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:49.472580 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-30f77816-f9ef-425a-9870-49cd357d8cb7 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] [instance: de47a5df-467d-41d2-ac4a-80d31da9a602] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:49.472703 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-30f77816-f9ef-425a-9870-49cd357d8cb7 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:49.473219 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-30f77816-f9ef-425a-9870-49cd357d8cb7 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:49.474069 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-30f77816-f9ef-425a-9870-49cd357d8cb7 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:49.474593 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-30f77816-f9ef-425a-9870-49cd357d8cb7 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:49.688257 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-30f77816-f9ef-425a-9870-49cd357d8cb7 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7d91983dc4c0fb218e7bdbc1c6558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6675985e19c44dabb624420aaa97b0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:49.696497 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-30f77816-f9ef-425a-9870-49cd357d8cb7 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] 10.222.0.40 "GET /compute/v2.1/servers/de47a5df-467d-41d2-ac4a-80d31da9a602" status: 200 len: 1318 microversion: 2.1 time: 0.236009 Aug 03 05:17:49.697082 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 331/629] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:49 2022] GET /compute/v2.1/servers/de47a5df-467d-41d2-ac4a-80d31da9a602 => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:17:49.871939 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-a1e53228-e721-48e2-b842-d7d1f1508361 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:49.871939 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-a1e53228-e721-48e2-b842-d7d1f1508361 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] [instance: 363118dd-a0c3-444f-99cb-f0578407e0d2] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:49.883234 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-a1e53228-e721-48e2-b842-d7d1f1508361 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:49.884611 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-a1e53228-e721-48e2-b842-d7d1f1508361 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:49.885519 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-a1e53228-e721-48e2-b842-d7d1f1508361 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:49.888195 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-a1e53228-e721-48e2-b842-d7d1f1508361 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:49.915188 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:17:49.999861 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-1193d063-cf9b-4719-b304-bea7c2fb02d3 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Action: 'create', calling method: .version_select at 0x7f7601ec2f70>, body: {"keypair": {"name": "tempest-keypair-927766371", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPMNaXaEx/nwQyEkN1B3MVD66GifKOZuNxyyGKtGylZ88oKnqq352fBmnrh//x0fgbW+YMdOAmcWH+GpL+C4MfLO20BehzdJkwC7l/2cpI27FQ5uhxS8CwBTESqTLFwBFQ=="}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:17:50.022414 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-1193d063-cf9b-4719-b304-bea7c2fb02d3 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Getting quotas for project 2e1ed25abd8e43009dd8f3f4b7ec1864. Resources: {'key_pairs'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:17:50.026713 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-1193d063-cf9b-4719-b304-bea7c2fb02d3 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Getting quotas for user f01737ba3200470c8635f335d0338ac8 and project 2e1ed25abd8e43009dd8f3f4b7ec1864. Resources: {'key_pairs'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:17:50.148851 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-1193d063-cf9b-4719-b304-bea7c2fb02d3 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.155549 Aug 03 05:17:50.151043 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 332/630] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Aug 3 05:17:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:17:50.362611 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-a1e53228-e721-48e2-b842-d7d1f1508361 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79539af2999d48baa11734ced32dccb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d7bf6baa2224b0d910133c5542608e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:50.370596 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-a1e53228-e721-48e2-b842-d7d1f1508361 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2" status: 200 len: 1757 microversion: 2.1 time: 0.503435 Aug 03 05:17:50.371757 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 299/631] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:49 2022] GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2 => generated 1757 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:17:50.717844 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-e5616d8f-0a16-4977-ab09-42073998d3eb tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:50.718489 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-e5616d8f-0a16-4977-ab09-42073998d3eb tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] [instance: de47a5df-467d-41d2-ac4a-80d31da9a602] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:50.724887 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e5616d8f-0a16-4977-ab09-42073998d3eb tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:50.725969 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e5616d8f-0a16-4977-ab09-42073998d3eb tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:50.726598 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e5616d8f-0a16-4977-ab09-42073998d3eb tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:50.727066 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e5616d8f-0a16-4977-ab09-42073998d3eb tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:50.732532 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:17:50.972450 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-e5616d8f-0a16-4977-ab09-42073998d3eb tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7d91983dc4c0fb218e7bdbc1c6558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6675985e19c44dabb624420aaa97b0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:50.980024 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-e5616d8f-0a16-4977-ab09-42073998d3eb tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] 10.222.0.40 "GET /compute/v2.1/servers/de47a5df-467d-41d2-ac4a-80d31da9a602" status: 200 len: 1318 microversion: 2.1 time: 0.266629 Aug 03 05:17:50.980602 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 333/632] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:50 2022] GET /compute/v2.1/servers/de47a5df-467d-41d2-ac4a-80d31da9a602 => generated 1318 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:17:51.392705 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-165b2eb7-a34d-4fbe-ab0e-98848137bec5 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:51.393314 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-165b2eb7-a34d-4fbe-ab0e-98848137bec5 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] [instance: 363118dd-a0c3-444f-99cb-f0578407e0d2] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:51.400003 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-165b2eb7-a34d-4fbe-ab0e-98848137bec5 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:51.404944 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-165b2eb7-a34d-4fbe-ab0e-98848137bec5 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:51.404944 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-165b2eb7-a34d-4fbe-ab0e-98848137bec5 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:51.404944 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-165b2eb7-a34d-4fbe-ab0e-98848137bec5 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:51.669148 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-165b2eb7-a34d-4fbe-ab0e-98848137bec5 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79539af2999d48baa11734ced32dccb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d7bf6baa2224b0d910133c5542608e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:51.677201 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-165b2eb7-a34d-4fbe-ab0e-98848137bec5 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2" status: 200 len: 1757 microversion: 2.1 time: 0.288517 Aug 03 05:17:51.677915 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 300/633] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:51 2022] GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2 => generated 1757 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:17:52.001360 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-b2814bd9-8407-4a3a-bf38-ae39c086d86d tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:52.001995 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-b2814bd9-8407-4a3a-bf38-ae39c086d86d tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] [instance: de47a5df-467d-41d2-ac4a-80d31da9a602] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:52.009114 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b2814bd9-8407-4a3a-bf38-ae39c086d86d tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:52.011242 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b2814bd9-8407-4a3a-bf38-ae39c086d86d tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:52.012777 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b2814bd9-8407-4a3a-bf38-ae39c086d86d tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:52.013378 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b2814bd9-8407-4a3a-bf38-ae39c086d86d tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:52.056744 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-44624d2f-c25f-41b9-96ea-e7e1437d9c1b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-362195497", "imageRef": "37d7ad4a-d925-48e6-84af-ec878f19050e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0627b724-9776-4eb0-bb73-1088cf117d0e"}], "security_groups": [{"name": "tempest-securitygroup--583312793"}], "key_name": "tempest-keypair-1230351880", "user_data": "}} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:17:52.274277 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.network.neutron [None req-44624d2f-c25f-41b9-96ea-e7e1437d9c1b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] validate_networks() for [('0627b724-9776-4eb0-bb73-1088cf117d0e', None, None, None, None, None)] {{(pid=118332) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:17:52.278859 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-b2814bd9-8407-4a3a-bf38-ae39c086d86d tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7d91983dc4c0fb218e7bdbc1c6558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6675985e19c44dabb624420aaa97b0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:52.286482 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-b2814bd9-8407-4a3a-bf38-ae39c086d86d tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] 10.222.0.40 "GET /compute/v2.1/servers/de47a5df-467d-41d2-ac4a-80d31da9a602" status: 200 len: 1318 microversion: 2.1 time: 0.289423 Aug 03 05:17:52.300744 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 334/634] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:51 2022] GET /compute/v2.1/servers/de47a5df-467d-41d2-ac4a-80d31da9a602 => generated 1318 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:17:52.700237 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-b483d24e-e154-441c-88f7-92235f37d61f tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:52.700855 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-b483d24e-e154-441c-88f7-92235f37d61f tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] [instance: 363118dd-a0c3-444f-99cb-f0578407e0d2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:52.703564 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell0:SELECT=2 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:17:52.708702 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b483d24e-e154-441c-88f7-92235f37d61f tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:52.709480 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b483d24e-e154-441c-88f7-92235f37d61f tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:52.712739 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b483d24e-e154-441c-88f7-92235f37d61f tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:52.712739 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b483d24e-e154-441c-88f7-92235f37d61f tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:53.282558 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-b483d24e-e154-441c-88f7-92235f37d61f tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79539af2999d48baa11734ced32dccb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d7bf6baa2224b0d910133c5542608e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:53.290950 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-b483d24e-e154-441c-88f7-92235f37d61f tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2" status: 200 len: 1757 microversion: 2.1 time: 0.594978 Aug 03 05:17:53.291530 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 335/635] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:52 2022] GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2 => generated 1757 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:17:53.298736 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-4b6c196f-37a6-4ce9-bc75-a15edb346b6d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1344084437", "imageRef": "37d7ad4a-d925-48e6-84af-ec878f19050e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fb45a44c-e06c-4c3d-aeef-17fe7186c5b8"}], "security_groups": [{"name": "tempest-securitygroup--150971248"}], "key_name": "tempest-keypair-927766371", "user_data": "}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:17:53.309747 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.virt.hardware [None req-44624d2f-c25f-41b9-96ea-e7e1437d9c1b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Flavor limits 0:0:0 {{(pid=118332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:17:53.309747 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.virt.hardware [None req-44624d2f-c25f-41b9-96ea-e7e1437d9c1b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Image limits 0:0:0 {{(pid=118332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:17:53.310374 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.virt.hardware [None req-44624d2f-c25f-41b9-96ea-e7e1437d9c1b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Flavor pref 0:0:0 {{(pid=118332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:17:53.310374 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.virt.hardware [None req-44624d2f-c25f-41b9-96ea-e7e1437d9c1b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Image pref 0:0:0 {{(pid=118332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:17:53.310682 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.virt.hardware [None req-44624d2f-c25f-41b9-96ea-e7e1437d9c1b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:17:53.321244 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-44624d2f-c25f-41b9-96ea-e7e1437d9c1b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:53.322032 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-44624d2f-c25f-41b9-96ea-e7e1437d9c1b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:53.323063 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-44624d2f-c25f-41b9-96ea-e7e1437d9c1b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:53.323714 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-44624d2f-c25f-41b9-96ea-e7e1437d9c1b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:53.351805 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.quota [None req-44624d2f-c25f-41b9-96ea-e7e1437d9c1b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Getting quotas for project 050592077e0b4d26a1555d2daa7f460d. Resources: {'instances', 'ram', 'cores'} {{(pid=118332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:17:53.356873 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.quota [None req-44624d2f-c25f-41b9-96ea-e7e1437d9c1b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Getting quotas for user 747a608061504d7693f0f99ecdfa476e and project 050592077e0b4d26a1555d2daa7f460d. Resources: {'instances', 'ram', 'cores'} {{(pid=118332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:17:53.368528 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-44624d2f-c25f-41b9-96ea-e7e1437d9c1b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Going to run 1 instances... {{(pid=118332) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:17:53.371514 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-44624d2f-c25f-41b9-96ea-e7e1437d9c1b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37d7ad4a-d925-48e6-84af-ec878f19050e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:17:53.496293 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-44624d2f-c25f-41b9-96ea-e7e1437d9c1b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.445194 Aug 03 05:17:53.497600 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 301/636] 10.222.0.40 () {62 vars in 1188 bytes} [Wed Aug 3 05:17:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 1447 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 03 05:17:53.503468 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-1901e3ac-4722-4f02-a685-89c2e377fdf7 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:53.504559 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-1901e3ac-4722-4f02-a685-89c2e377fdf7 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] [instance: de47a5df-467d-41d2-ac4a-80d31da9a602] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:53.514094 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-1901e3ac-4722-4f02-a685-89c2e377fdf7 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:53.515601 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-1901e3ac-4722-4f02-a685-89c2e377fdf7 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:53.516850 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-1901e3ac-4722-4f02-a685-89c2e377fdf7 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:53.517324 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-1901e3ac-4722-4f02-a685-89c2e377fdf7 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:53.546581 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.network.neutron [None req-4b6c196f-37a6-4ce9-bc75-a15edb346b6d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] validate_networks() for [('fb45a44c-e06c-4c3d-aeef-17fe7186c5b8', None, None, None, None, None)] {{(pid=118331) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:17:53.795260 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-1901e3ac-4722-4f02-a685-89c2e377fdf7 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7d91983dc4c0fb218e7bdbc1c6558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6675985e19c44dabb624420aaa97b0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:53.795260 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-1901e3ac-4722-4f02-a685-89c2e377fdf7 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] 10.222.0.40 "GET /compute/v2.1/servers/de47a5df-467d-41d2-ac4a-80d31da9a602" status: 200 len: 1318 microversion: 2.1 time: 0.276643 Aug 03 05:17:53.795260 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 302/637] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:53 2022] GET /compute/v2.1/servers/de47a5df-467d-41d2-ac4a-80d31da9a602 => generated 1318 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:17:53.795260 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-8babb6cf-25de-485d-bcb6-8cf3d5494151 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:53.796930 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-8babb6cf-25de-485d-bcb6-8cf3d5494151 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:53.796930 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:17:53.841897 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-8babb6cf-25de-485d-bcb6-8cf3d5494151 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:53.849577 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-8babb6cf-25de-485d-bcb6-8cf3d5494151 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:53.851125 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-8babb6cf-25de-485d-bcb6-8cf3d5494151 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:53.852241 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-8babb6cf-25de-485d-bcb6-8cf3d5494151 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 200 len: 1281 microversion: 2.20 time: 0.075083 Aug 03 05:17:53.852828 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 303/638] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:17:53 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 1281 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:17:54.039001 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-4b6c196f-37a6-4ce9-bc75-a15edb346b6d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Flavor limits 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:17:54.044340 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-4b6c196f-37a6-4ce9-bc75-a15edb346b6d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Image limits 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:17:54.044340 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-4b6c196f-37a6-4ce9-bc75-a15edb346b6d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Flavor pref 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:17:54.044340 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-4b6c196f-37a6-4ce9-bc75-a15edb346b6d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Image pref 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:17:54.044340 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-4b6c196f-37a6-4ce9-bc75-a15edb346b6d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:17:54.050191 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4b6c196f-37a6-4ce9-bc75-a15edb346b6d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:54.050560 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4b6c196f-37a6-4ce9-bc75-a15edb346b6d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:54.051506 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4b6c196f-37a6-4ce9-bc75-a15edb346b6d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:54.051974 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4b6c196f-37a6-4ce9-bc75-a15edb346b6d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:54.069673 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-4b6c196f-37a6-4ce9-bc75-a15edb346b6d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Getting quotas for project 2e1ed25abd8e43009dd8f3f4b7ec1864. Resources: {'instances', 'ram', 'cores'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:17:54.073893 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-4b6c196f-37a6-4ce9-bc75-a15edb346b6d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Getting quotas for user f01737ba3200470c8635f335d0338ac8 and project 2e1ed25abd8e43009dd8f3f4b7ec1864. Resources: {'instances', 'ram', 'cores'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:17:54.076893 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:17:54.086160 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-4b6c196f-37a6-4ce9-bc75-a15edb346b6d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Going to run 1 instances... {{(pid=118331) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:17:54.088715 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-4b6c196f-37a6-4ce9-bc75-a15edb346b6d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: ddb3fb62-23ee-4e46-b198-e30b98687d24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37d7ad4a-d925-48e6-84af-ec878f19050e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:17:54.283090 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-4b6c196f-37a6-4ce9-bc75-a15edb346b6d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.990480 Aug 03 05:17:54.284163 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 336/639] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Aug 3 05:17:53 2022] POST /compute/v2.1/servers => generated 401 bytes in 992 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 05:17:54.295407 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-7b2f5e83-19fa-4431-bfa6-add885d73113 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:54.298104 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-7b2f5e83-19fa-4431-bfa6-add885d73113 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: ddb3fb62-23ee-4e46-b198-e30b98687d24] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:54.312405 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-17a8c21b-8d27-41f5-b2ca-d26b0f3e4604 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:54.313282 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-17a8c21b-8d27-41f5-b2ca-d26b0f3e4604 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] [instance: 363118dd-a0c3-444f-99cb-f0578407e0d2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:54.320658 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-17a8c21b-8d27-41f5-b2ca-d26b0f3e4604 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:54.321261 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-17a8c21b-8d27-41f5-b2ca-d26b0f3e4604 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:54.322062 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-17a8c21b-8d27-41f5-b2ca-d26b0f3e4604 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:54.322503 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-17a8c21b-8d27-41f5-b2ca-d26b0f3e4604 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:54.366020 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-7b2f5e83-19fa-4431-bfa6-add885d73113 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:54.373649 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-7b2f5e83-19fa-4431-bfa6-add885d73113 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24" status: 200 len: 1237 microversion: 2.1 time: 0.082723 Aug 03 05:17:54.374351 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 304/640] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:54 2022] GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24 => generated 1237 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:17:54.488009 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-17a8c21b-8d27-41f5-b2ca-d26b0f3e4604 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79539af2999d48baa11734ced32dccb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d7bf6baa2224b0d910133c5542608e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:54.496652 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-17a8c21b-8d27-41f5-b2ca-d26b0f3e4604 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2" status: 200 len: 1757 microversion: 2.1 time: 0.187795 Aug 03 05:17:54.497229 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 337/641] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:54 2022] GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2 => generated 1757 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:17:54.797582 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-cfa58700-9b13-45b5-8163-b8da8065889d tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:54.798514 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-cfa58700-9b13-45b5-8163-b8da8065889d tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] [instance: de47a5df-467d-41d2-ac4a-80d31da9a602] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:54.805921 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-cfa58700-9b13-45b5-8163-b8da8065889d tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:54.806453 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-cfa58700-9b13-45b5-8163-b8da8065889d tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:54.807259 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-cfa58700-9b13-45b5-8163-b8da8065889d tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:54.807704 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-cfa58700-9b13-45b5-8163-b8da8065889d tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:54.875629 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-05fc20d9-ef4c-441b-a534-1958e0340dd5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:54.876180 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-05fc20d9-ef4c-441b-a534-1958e0340dd5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:54.891803 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-05fc20d9-ef4c-441b-a534-1958e0340dd5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:54.892705 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-05fc20d9-ef4c-441b-a534-1958e0340dd5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:54.894236 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-05fc20d9-ef4c-441b-a534-1958e0340dd5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:54.894879 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-05fc20d9-ef4c-441b-a534-1958e0340dd5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:54.962995 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-cfa58700-9b13-45b5-8163-b8da8065889d tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7d91983dc4c0fb218e7bdbc1c6558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6675985e19c44dabb624420aaa97b0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:54.969377 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-cfa58700-9b13-45b5-8163-b8da8065889d tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] 10.222.0.40 "GET /compute/v2.1/servers/de47a5df-467d-41d2-ac4a-80d31da9a602" status: 200 len: 1318 microversion: 2.1 time: 0.176261 Aug 03 05:17:54.969964 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 305/642] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:54 2022] GET /compute/v2.1/servers/de47a5df-467d-41d2-ac4a-80d31da9a602 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:17:54.990578 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-05fc20d9-ef4c-441b-a534-1958e0340dd5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:55.000073 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-05fc20d9-ef4c-441b-a534-1958e0340dd5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:55.001609 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-05fc20d9-ef4c-441b-a534-1958e0340dd5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:55.003360 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-05fc20d9-ef4c-441b-a534-1958e0340dd5 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 200 len: 1285 microversion: 2.20 time: 0.131664 Aug 03 05:17:55.006932 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 338/643] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:17:54 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 1285 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 05:17:55.030792 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [req-727c60c8-eb60-4238-9297-9ea0696f3482 req-645268da-bd4e-4c20-9e81-4bc5e0763586 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de47a5df-467d-41d2-ac4a-80d31da9a602", "name": "network-vif-plugged", "status": "completed", "tag": "1b3364e7-57bb-4ce8-a503-12f0787c7875"}]} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:17:55.042030 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-727c60c8-eb60-4238-9297-9ea0696f3482 req-645268da-bd4e-4c20-9e81-4bc5e0763586 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:55.042485 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-727c60c8-eb60-4238-9297-9ea0696f3482 req-645268da-bd4e-4c20-9e81-4bc5e0763586 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:55.053622 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.compute.server_external_events [req-727c60c8-eb60-4238-9297-9ea0696f3482 req-645268da-bd4e-4c20-9e81-4bc5e0763586 service nova] Creating event network-vif-plugged:1b3364e7-57bb-4ce8-a503-12f0787c7875 for instance de47a5df-467d-41d2-ac4a-80d31da9a602 on hv-cinder-85127 Aug 03 05:17:55.058820 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [req-727c60c8-eb60-4238-9297-9ea0696f3482 req-645268da-bd4e-4c20-9e81-4bc5e0763586 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034596 Aug 03 05:17:55.059446 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 306/644] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:17:55.395821 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-8e9435da-d79f-482a-90a4-add5e20a669f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:55.396448 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-8e9435da-d79f-482a-90a4-add5e20a669f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: ddb3fb62-23ee-4e46-b198-e30b98687d24] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:55.403834 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8e9435da-d79f-482a-90a4-add5e20a669f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:55.404286 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8e9435da-d79f-482a-90a4-add5e20a669f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:55.405055 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8e9435da-d79f-482a-90a4-add5e20a669f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:55.405495 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8e9435da-d79f-482a-90a4-add5e20a669f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:55.473108 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-8e9435da-d79f-482a-90a4-add5e20a669f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:55.474881 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-8e9435da-d79f-482a-90a4-add5e20a669f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24" status: 200 len: 1241 microversion: 2.1 time: 0.082927 Aug 03 05:17:55.475460 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 339/645] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:55 2022] GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24 => generated 1241 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:17:55.518428 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-dcdaf93b-c2e0-4611-8469-6574fe0450a9 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:55.519173 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-dcdaf93b-c2e0-4611-8469-6574fe0450a9 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] [instance: 363118dd-a0c3-444f-99cb-f0578407e0d2] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:55.526021 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-dcdaf93b-c2e0-4611-8469-6574fe0450a9 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:55.526474 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-dcdaf93b-c2e0-4611-8469-6574fe0450a9 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:55.527806 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-dcdaf93b-c2e0-4611-8469-6574fe0450a9 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:55.528250 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-dcdaf93b-c2e0-4611-8469-6574fe0450a9 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:55.758593 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-dcdaf93b-c2e0-4611-8469-6574fe0450a9 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79539af2999d48baa11734ced32dccb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d7bf6baa2224b0d910133c5542608e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:55.765082 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-dcdaf93b-c2e0-4611-8469-6574fe0450a9 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2" status: 200 len: 1757 microversion: 2.1 time: 0.250862 Aug 03 05:17:55.765652 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 307/646] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:55 2022] GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2 => generated 1757 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:17:55.989797 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-5f9fbe39-28db-4162-a7f1-b7347f420488 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:55.990504 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-5f9fbe39-28db-4162-a7f1-b7347f420488 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] [instance: de47a5df-467d-41d2-ac4a-80d31da9a602] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:55.997689 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5f9fbe39-28db-4162-a7f1-b7347f420488 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:55.998149 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5f9fbe39-28db-4162-a7f1-b7347f420488 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:55.998950 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5f9fbe39-28db-4162-a7f1-b7347f420488 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:55.999396 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5f9fbe39-28db-4162-a7f1-b7347f420488 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:56.026312 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-7540425a-9391-42de-9aa7-c52a7f12c49b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:56.027690 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-7540425a-9391-42de-9aa7-c52a7f12c49b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:56.037643 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-7540425a-9391-42de-9aa7-c52a7f12c49b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:56.038210 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-7540425a-9391-42de-9aa7-c52a7f12c49b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:56.039117 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-7540425a-9391-42de-9aa7-c52a7f12c49b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:56.039606 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-7540425a-9391-42de-9aa7-c52a7f12c49b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:56.144552 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-7540425a-9391-42de-9aa7-c52a7f12c49b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:56.153977 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-7540425a-9391-42de-9aa7-c52a7f12c49b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:56.159870 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-7540425a-9391-42de-9aa7-c52a7f12c49b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:56.171032 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-7540425a-9391-42de-9aa7-c52a7f12c49b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 200 len: 1341 microversion: 2.20 time: 0.138984 Aug 03 05:17:56.171032 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 308/647] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:17:56 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 1341 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 05:17:56.212853 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-5f9fbe39-28db-4162-a7f1-b7347f420488 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7d91983dc4c0fb218e7bdbc1c6558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6675985e19c44dabb624420aaa97b0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:56.220874 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-5f9fbe39-28db-4162-a7f1-b7347f420488 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] 10.222.0.40 "GET /compute/v2.1/servers/de47a5df-467d-41d2-ac4a-80d31da9a602" status: 200 len: 1318 microversion: 2.1 time: 0.235100 Aug 03 05:17:56.221447 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 340/648] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:55 2022] GET /compute/v2.1/servers/de47a5df-467d-41d2-ac4a-80d31da9a602 => generated 1318 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:17:56.496388 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-4c9e854e-27a0-4345-a40a-1b20d0f19b0f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:56.496997 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-4c9e854e-27a0-4345-a40a-1b20d0f19b0f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: ddb3fb62-23ee-4e46-b198-e30b98687d24] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:56.503045 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-4c9e854e-27a0-4345-a40a-1b20d0f19b0f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:56.503499 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-4c9e854e-27a0-4345-a40a-1b20d0f19b0f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:56.504263 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-4c9e854e-27a0-4345-a40a-1b20d0f19b0f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:56.504702 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-4c9e854e-27a0-4345-a40a-1b20d0f19b0f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:56.583509 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-4c9e854e-27a0-4345-a40a-1b20d0f19b0f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:56.591999 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-4c9e854e-27a0-4345-a40a-1b20d0f19b0f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24" status: 200 len: 1289 microversion: 2.1 time: 0.099535 Aug 03 05:17:56.595230 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 309/649] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:56 2022] GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24 => generated 1289 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:17:56.786890 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-456678da-1f59-4527-b21c-d6d94d79c0d5 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:56.787523 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-456678da-1f59-4527-b21c-d6d94d79c0d5 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] [instance: 363118dd-a0c3-444f-99cb-f0578407e0d2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:56.794156 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-456678da-1f59-4527-b21c-d6d94d79c0d5 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:56.794645 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-456678da-1f59-4527-b21c-d6d94d79c0d5 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:56.795531 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-456678da-1f59-4527-b21c-d6d94d79c0d5 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:56.795975 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-456678da-1f59-4527-b21c-d6d94d79c0d5 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:57.042055 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-456678da-1f59-4527-b21c-d6d94d79c0d5 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79539af2999d48baa11734ced32dccb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d7bf6baa2224b0d910133c5542608e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:57.050525 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-456678da-1f59-4527-b21c-d6d94d79c0d5 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2" status: 200 len: 1757 microversion: 2.1 time: 0.267550 Aug 03 05:17:57.051153 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 341/650] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:56 2022] GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2 => generated 1757 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:17:57.186410 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-5846e1ae-b804-4cea-94fa-11c5d87d193c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:57.187043 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-5846e1ae-b804-4cea-94fa-11c5d87d193c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:57.193564 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-5846e1ae-b804-4cea-94fa-11c5d87d193c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:57.194012 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-5846e1ae-b804-4cea-94fa-11c5d87d193c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:57.194768 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-5846e1ae-b804-4cea-94fa-11c5d87d193c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:57.195227 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-5846e1ae-b804-4cea-94fa-11c5d87d193c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:57.241362 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-b7cecae3-df3e-47ae-8a68-361312f1f690 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:57.241963 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-b7cecae3-df3e-47ae-8a68-361312f1f690 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] [instance: de47a5df-467d-41d2-ac4a-80d31da9a602] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:57.248677 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b7cecae3-df3e-47ae-8a68-361312f1f690 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:57.249216 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b7cecae3-df3e-47ae-8a68-361312f1f690 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:57.249983 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b7cecae3-df3e-47ae-8a68-361312f1f690 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:57.250421 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b7cecae3-df3e-47ae-8a68-361312f1f690 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:57.259110 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-5846e1ae-b804-4cea-94fa-11c5d87d193c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:57.267322 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-5846e1ae-b804-4cea-94fa-11c5d87d193c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:57.268923 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-5846e1ae-b804-4cea-94fa-11c5d87d193c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:57.270101 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-5846e1ae-b804-4cea-94fa-11c5d87d193c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 200 len: 1339 microversion: 2.20 time: 0.088171 Aug 03 05:17:57.270678 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 310/651] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:17:57 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 1339 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:17:57.527665 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-b7cecae3-df3e-47ae-8a68-361312f1f690 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7d91983dc4c0fb218e7bdbc1c6558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6675985e19c44dabb624420aaa97b0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:57.537382 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-b7cecae3-df3e-47ae-8a68-361312f1f690 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] 10.222.0.40 "GET /compute/v2.1/servers/de47a5df-467d-41d2-ac4a-80d31da9a602" status: 200 len: 1507 microversion: 2.1 time: 0.299730 Aug 03 05:17:57.538004 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 342/652] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:57 2022] GET /compute/v2.1/servers/de47a5df-467d-41d2-ac4a-80d31da9a602 => generated 1507 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:17:57.567932 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-bb7d9d1a-38cf-4148-8305-58c2d5bb4b9d tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a251912b-3c39-4778-8f84-19b10565ee1e", "device": "/dev/sdb"}} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:17:57.570888 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-bb7d9d1a-38cf-4148-8305-58c2d5bb4b9d tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] [instance: de47a5df-467d-41d2-ac4a-80d31da9a602] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:57.578668 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-bb7d9d1a-38cf-4148-8305-58c2d5bb4b9d tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:57.585269 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-bb7d9d1a-38cf-4148-8305-58c2d5bb4b9d tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:57.585269 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-bb7d9d1a-38cf-4148-8305-58c2d5bb4b9d tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:57.587434 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-bb7d9d1a-38cf-4148-8305-58c2d5bb4b9d tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:57.614759 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-ee85ed6b-5d24-4029-8465-af631be72efd tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:57.615432 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-ee85ed6b-5d24-4029-8465-af631be72efd tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: ddb3fb62-23ee-4e46-b198-e30b98687d24] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:57.628380 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ee85ed6b-5d24-4029-8465-af631be72efd tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:57.628380 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ee85ed6b-5d24-4029-8465-af631be72efd tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:57.628380 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ee85ed6b-5d24-4029-8465-af631be72efd tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:57.628380 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ee85ed6b-5d24-4029-8465-af631be72efd tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:57.753200 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-ee85ed6b-5d24-4029-8465-af631be72efd tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:57.760649 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-ee85ed6b-5d24-4029-8465-af631be72efd tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24" status: 200 len: 1297 microversion: 2.1 time: 0.151065 Aug 03 05:17:57.761220 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 343/653] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:57 2022] GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24 => generated 1297 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:17:58.072027 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-0fac0a5c-ff83-4e13-b3eb-e7f8ba433664 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:58.072751 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-0fac0a5c-ff83-4e13-b3eb-e7f8ba433664 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] [instance: 363118dd-a0c3-444f-99cb-f0578407e0d2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:58.079073 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0fac0a5c-ff83-4e13-b3eb-e7f8ba433664 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:58.084596 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0fac0a5c-ff83-4e13-b3eb-e7f8ba433664 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:58.084596 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0fac0a5c-ff83-4e13-b3eb-e7f8ba433664 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:58.084596 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0fac0a5c-ff83-4e13-b3eb-e7f8ba433664 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:58.329191 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-0fac0a5c-ff83-4e13-b3eb-e7f8ba433664 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79539af2999d48baa11734ced32dccb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d7bf6baa2224b0d910133c5542608e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:58.337562 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-0fac0a5c-ff83-4e13-b3eb-e7f8ba433664 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2" status: 200 len: 1757 microversion: 2.1 time: 0.269299 Aug 03 05:17:58.338132 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 344/654] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:58 2022] GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2 => generated 1757 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:17:58.356186 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-dc3da33b-836c-445e-954a-80117e3ce827 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:58.356186 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-dc3da33b-836c-445e-954a-80117e3ce827 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:58.356186 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-dc3da33b-836c-445e-954a-80117e3ce827 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:58.356186 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-dc3da33b-836c-445e-954a-80117e3ce827 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:58.356640 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-dc3da33b-836c-445e-954a-80117e3ce827 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:58.356640 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-dc3da33b-836c-445e-954a-80117e3ce827 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:58.645999 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-bb7d9d1a-38cf-4148-8305-58c2d5bb4b9d tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] 10.222.0.40 "POST /compute/v2.1/servers/de47a5df-467d-41d2-ac4a-80d31da9a602/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.082461 Aug 03 05:17:58.646835 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 311/655] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Aug 3 05:17:57 2022] POST /compute/v2.1/servers/de47a5df-467d-41d2-ac4a-80d31da9a602/os-volume_attachments => generated 194 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:17:58.663641 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-dc3da33b-836c-445e-954a-80117e3ce827 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:58.675306 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-dc3da33b-836c-445e-954a-80117e3ce827 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:58.676815 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-dc3da33b-836c-445e-954a-80117e3ce827 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:58.678588 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-dc3da33b-836c-445e-954a-80117e3ce827 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 200 len: 1406 microversion: 2.20 time: 0.337833 Aug 03 05:17:58.679750 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 345/656] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:17:58 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 1406 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:17:58.786176 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-42937bcf-6d9e-4e08-97a1-4d92d06793f1 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:58.787114 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-42937bcf-6d9e-4e08-97a1-4d92d06793f1 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: ddb3fb62-23ee-4e46-b198-e30b98687d24] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:58.793726 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-42937bcf-6d9e-4e08-97a1-4d92d06793f1 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:58.794380 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-42937bcf-6d9e-4e08-97a1-4d92d06793f1 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:58.795246 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-42937bcf-6d9e-4e08-97a1-4d92d06793f1 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:58.795743 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-42937bcf-6d9e-4e08-97a1-4d92d06793f1 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:58.866367 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-42937bcf-6d9e-4e08-97a1-4d92d06793f1 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:58.875757 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-42937bcf-6d9e-4e08-97a1-4d92d06793f1 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24" status: 200 len: 1295 microversion: 2.1 time: 0.096162 Aug 03 05:17:58.876508 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 312/657] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:58 2022] GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24 => generated 1295 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:17:58.894813 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-10a63178-9cda-488c-993b-b003fee65ed7 req-1ce17125-0f02-4dcc-9ba8-be9775e87737 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67b3164b-4fb1-4812-94b7-cc60b3040700", "tag": "ac9d083a-77d7-4d9d-a0ea-ee7b9f6e3aab"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:17:58.905079 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-10a63178-9cda-488c-993b-b003fee65ed7 req-1ce17125-0f02-4dcc-9ba8-be9775e87737 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:58.905613 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-10a63178-9cda-488c-993b-b003fee65ed7 req-1ce17125-0f02-4dcc-9ba8-be9775e87737 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:58.917185 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-10a63178-9cda-488c-993b-b003fee65ed7 req-1ce17125-0f02-4dcc-9ba8-be9775e87737 service nova] Creating event network-changed:ac9d083a-77d7-4d9d-a0ea-ee7b9f6e3aab for instance 67b3164b-4fb1-4812-94b7-cc60b3040700 on hv-cinder-85127 Aug 03 05:17:58.923058 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-10a63178-9cda-488c-993b-b003fee65ed7 req-1ce17125-0f02-4dcc-9ba8-be9775e87737 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032056 Aug 03 05:17:58.923669 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 346/658] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:17:59.365018 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-732ee58f-4788-42ca-8a71-6b1191129b39 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:59.367232 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-732ee58f-4788-42ca-8a71-6b1191129b39 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] [instance: 363118dd-a0c3-444f-99cb-f0578407e0d2] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:59.374471 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-732ee58f-4788-42ca-8a71-6b1191129b39 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:59.374941 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-732ee58f-4788-42ca-8a71-6b1191129b39 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:59.375743 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-732ee58f-4788-42ca-8a71-6b1191129b39 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:59.376183 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-732ee58f-4788-42ca-8a71-6b1191129b39 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:59.745603 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-732ee58f-4788-42ca-8a71-6b1191129b39 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79539af2999d48baa11734ced32dccb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d7bf6baa2224b0d910133c5542608e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:59.758345 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-732ee58f-4788-42ca-8a71-6b1191129b39 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2" status: 200 len: 1757 microversion: 2.1 time: 0.397686 Aug 03 05:17:59.759145 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 313/659] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:59 2022] GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2 => generated 1757 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:17:59.771546 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-b561fd38-0f65-4cfc-9d10-a2acc575d477 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:59.772042 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-b561fd38-0f65-4cfc-9d10-a2acc575d477 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:59.778591 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b561fd38-0f65-4cfc-9d10-a2acc575d477 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:59.779384 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b561fd38-0f65-4cfc-9d10-a2acc575d477 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:59.780353 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b561fd38-0f65-4cfc-9d10-a2acc575d477 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:59.780968 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b561fd38-0f65-4cfc-9d10-a2acc575d477 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:59.899629 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-27fe8081-b2a8-4e72-946f-cdbaee3d1f68 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:59.900160 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-27fe8081-b2a8-4e72-946f-cdbaee3d1f68 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: ddb3fb62-23ee-4e46-b198-e30b98687d24] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:59.906805 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-27fe8081-b2a8-4e72-946f-cdbaee3d1f68 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:59.907288 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-27fe8081-b2a8-4e72-946f-cdbaee3d1f68 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:59.908093 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-27fe8081-b2a8-4e72-946f-cdbaee3d1f68 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:59.908535 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-27fe8081-b2a8-4e72-946f-cdbaee3d1f68 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:00.398648 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-b561fd38-0f65-4cfc-9d10-a2acc575d477 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:00.407595 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-b561fd38-0f65-4cfc-9d10-a2acc575d477 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:00.409097 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-b561fd38-0f65-4cfc-9d10-a2acc575d477 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:00.410208 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-b561fd38-0f65-4cfc-9d10-a2acc575d477 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 200 len: 1406 microversion: 2.20 time: 0.712496 Aug 03 05:18:00.410764 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 347/660] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:17:59 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 1406 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 05:18:00.522073 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-27fe8081-b2a8-4e72-946f-cdbaee3d1f68 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:00.530436 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-27fe8081-b2a8-4e72-946f-cdbaee3d1f68 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24" status: 200 len: 1362 microversion: 2.1 time: 0.635344 Aug 03 05:18:00.531236 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 314/661] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:59 2022] GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24 => generated 1362 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:18:00.782169 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-7c5c31bc-6c9f-4774-9693-fed693b964cd tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:00.782755 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-7c5c31bc-6c9f-4774-9693-fed693b964cd tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] [instance: 363118dd-a0c3-444f-99cb-f0578407e0d2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:00.789255 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7c5c31bc-6c9f-4774-9693-fed693b964cd tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:00.789732 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7c5c31bc-6c9f-4774-9693-fed693b964cd tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:00.790475 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7c5c31bc-6c9f-4774-9693-fed693b964cd tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:00.790928 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7c5c31bc-6c9f-4774-9693-fed693b964cd tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:00.943196 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [req-a8ce6299-6e96-436f-9275-4e7856c94da3 req-7ed93836-42e3-4ddf-bcc2-ebb675c17851 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddb3fb62-23ee-4e46-b198-e30b98687d24", "tag": "295bab3a-078d-47dd-a131-28f87fd072a1"}]} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:18:00.953408 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-7c5c31bc-6c9f-4774-9693-fed693b964cd tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79539af2999d48baa11734ced32dccb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d7bf6baa2224b0d910133c5542608e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:00.956149 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-a8ce6299-6e96-436f-9275-4e7856c94da3 req-7ed93836-42e3-4ddf-bcc2-ebb675c17851 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:00.956602 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-a8ce6299-6e96-436f-9275-4e7856c94da3 req-7ed93836-42e3-4ddf-bcc2-ebb675c17851 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:00.961748 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-7c5c31bc-6c9f-4774-9693-fed693b964cd tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2" status: 200 len: 1757 microversion: 2.1 time: 0.183252 Aug 03 05:18:00.962493 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 348/662] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:00 2022] GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2 => generated 1757 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:18:00.968592 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.compute.server_external_events [req-a8ce6299-6e96-436f-9275-4e7856c94da3 req-7ed93836-42e3-4ddf-bcc2-ebb675c17851 service nova] Creating event network-changed:295bab3a-078d-47dd-a131-28f87fd072a1 for instance ddb3fb62-23ee-4e46-b198-e30b98687d24 on hv-cinder-85127 Aug 03 05:18:00.973239 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [req-a8ce6299-6e96-436f-9275-4e7856c94da3 req-7ed93836-42e3-4ddf-bcc2-ebb675c17851 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034970 Aug 03 05:18:00.973822 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 315/663] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:18:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:18:01.433310 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-784dd155-8af8-4b37-bc7b-63c82137beab tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:01.433933 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-784dd155-8af8-4b37-bc7b-63c82137beab tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:01.445638 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-784dd155-8af8-4b37-bc7b-63c82137beab tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:01.446092 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-784dd155-8af8-4b37-bc7b-63c82137beab tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:01.446898 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-784dd155-8af8-4b37-bc7b-63c82137beab tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:01.447365 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-784dd155-8af8-4b37-bc7b-63c82137beab tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:01.551996 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-471ba3ae-6715-4cc7-b0e3-0cd1a8676ef9 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:01.552609 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-471ba3ae-6715-4cc7-b0e3-0cd1a8676ef9 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: ddb3fb62-23ee-4e46-b198-e30b98687d24] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:01.559196 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-471ba3ae-6715-4cc7-b0e3-0cd1a8676ef9 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:01.559385 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-471ba3ae-6715-4cc7-b0e3-0cd1a8676ef9 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:01.560243 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-471ba3ae-6715-4cc7-b0e3-0cd1a8676ef9 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:01.560683 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-471ba3ae-6715-4cc7-b0e3-0cd1a8676ef9 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:01.580311 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-784dd155-8af8-4b37-bc7b-63c82137beab tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:01.589672 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-784dd155-8af8-4b37-bc7b-63c82137beab tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:01.591534 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-784dd155-8af8-4b37-bc7b-63c82137beab tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:01.592759 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-784dd155-8af8-4b37-bc7b-63c82137beab tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 200 len: 1406 microversion: 2.20 time: 0.163392 Aug 03 05:18:01.593334 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 349/664] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:18:01 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:18:01.707934 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-471ba3ae-6715-4cc7-b0e3-0cd1a8676ef9 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:01.716083 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-471ba3ae-6715-4cc7-b0e3-0cd1a8676ef9 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24" status: 200 len: 1362 microversion: 2.1 time: 0.168807 Aug 03 05:18:01.716762 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 316/665] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:01 2022] GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:18:01.983765 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-760830bb-dc1e-4114-a026-9f1de84f34af tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:01.984368 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-760830bb-dc1e-4114-a026-9f1de84f34af tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] [instance: 363118dd-a0c3-444f-99cb-f0578407e0d2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:01.991019 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-760830bb-dc1e-4114-a026-9f1de84f34af tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:01.991464 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-760830bb-dc1e-4114-a026-9f1de84f34af tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:01.992341 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-760830bb-dc1e-4114-a026-9f1de84f34af tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:01.992781 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-760830bb-dc1e-4114-a026-9f1de84f34af tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:02.238385 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-760830bb-dc1e-4114-a026-9f1de84f34af tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79539af2999d48baa11734ced32dccb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d7bf6baa2224b0d910133c5542608e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:02.247238 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-760830bb-dc1e-4114-a026-9f1de84f34af tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2" status: 200 len: 1760 microversion: 2.1 time: 0.267336 Aug 03 05:18:02.247832 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 350/666] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:01 2022] GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2 => generated 1760 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:18:02.620049 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-5980a3b7-07f0-463e-975b-95268279c782 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:02.621413 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-5980a3b7-07f0-463e-975b-95268279c782 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:02.628063 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-5980a3b7-07f0-463e-975b-95268279c782 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:02.628511 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-5980a3b7-07f0-463e-975b-95268279c782 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:02.629283 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-5980a3b7-07f0-463e-975b-95268279c782 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:02.629719 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-5980a3b7-07f0-463e-975b-95268279c782 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:02.737399 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-60673d6b-8600-4f7f-889c-3ed89de61b6b tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:02.738018 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-60673d6b-8600-4f7f-889c-3ed89de61b6b tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: ddb3fb62-23ee-4e46-b198-e30b98687d24] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:02.744197 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-60673d6b-8600-4f7f-889c-3ed89de61b6b tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:02.744648 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-60673d6b-8600-4f7f-889c-3ed89de61b6b tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:02.746061 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-60673d6b-8600-4f7f-889c-3ed89de61b6b tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:02.746589 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-60673d6b-8600-4f7f-889c-3ed89de61b6b tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:02.749539 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=100 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:18:02.878527 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-5980a3b7-07f0-463e-975b-95268279c782 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:02.887614 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-5980a3b7-07f0-463e-975b-95268279c782 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:02.889709 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-5980a3b7-07f0-463e-975b-95268279c782 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:02.890944 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-5980a3b7-07f0-463e-975b-95268279c782 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 200 len: 1406 microversion: 2.20 time: 0.274971 Aug 03 05:18:02.901442 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 317/667] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:18:02 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 1406 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:18:02.952057 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-60673d6b-8600-4f7f-889c-3ed89de61b6b tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:02.961797 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-60673d6b-8600-4f7f-889c-3ed89de61b6b tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24" status: 200 len: 1362 microversion: 2.1 time: 0.226501 Aug 03 05:18:02.961797 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 351/668] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:02 2022] GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24 => generated 1362 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:18:03.915309 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-9a936235-4ae3-47ab-aacf-d07664dee225 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:03.915935 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-9a936235-4ae3-47ab-aacf-d07664dee225 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:03.918447 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_cell0:SELECT=2 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:18:03.923849 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-9a936235-4ae3-47ab-aacf-d07664dee225 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:03.926989 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-9a936235-4ae3-47ab-aacf-d07664dee225 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:03.926989 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-9a936235-4ae3-47ab-aacf-d07664dee225 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:03.926989 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-9a936235-4ae3-47ab-aacf-d07664dee225 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:03.982766 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-1c1d085f-d66e-4f26-a68e-0713ab917218 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:03.983186 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-1c1d085f-d66e-4f26-a68e-0713ab917218 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: ddb3fb62-23ee-4e46-b198-e30b98687d24] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:03.989427 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1c1d085f-d66e-4f26-a68e-0713ab917218 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:03.990033 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1c1d085f-d66e-4f26-a68e-0713ab917218 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:03.990806 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1c1d085f-d66e-4f26-a68e-0713ab917218 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:03.991268 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1c1d085f-d66e-4f26-a68e-0713ab917218 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:04.061198 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell0:SELECT=2 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:18:04.081712 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell0:SELECT=18 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:18:04.104210 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-9a936235-4ae3-47ab-aacf-d07664dee225 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:04.107679 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:18:04.112910 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-9a936235-4ae3-47ab-aacf-d07664dee225 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:04.114462 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-9a936235-4ae3-47ab-aacf-d07664dee225 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:04.115595 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-9a936235-4ae3-47ab-aacf-d07664dee225 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 200 len: 1406 microversion: 2.20 time: 0.204538 Aug 03 05:18:04.116530 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 318/669] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:18:03 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 1406 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:18:04.152762 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-1c1d085f-d66e-4f26-a68e-0713ab917218 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:04.160162 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-1c1d085f-d66e-4f26-a68e-0713ab917218 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24" status: 200 len: 1362 microversion: 2.1 time: 0.182565 Aug 03 05:18:04.160737 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 352/670] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:03 2022] GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24 => generated 1362 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:18:05.140920 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-aa0aa061-4671-47a3-b0d3-c67c3dfaf9e2 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:05.140920 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-aa0aa061-4671-47a3-b0d3-c67c3dfaf9e2 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:05.141566 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_cell0:SELECT=14 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:18:05.147203 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-2dfc74d0-276b-4cd6-b4b2-db178f7ca9c1 req-8b8a5aad-959f-49fe-9302-d4720f14e9b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67b3164b-4fb1-4812-94b7-cc60b3040700", "name": "network-vif-plugged", "status": "completed", "tag": "ac9d083a-77d7-4d9d-a0ea-ee7b9f6e3aab"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:18:05.157729 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-aa0aa061-4671-47a3-b0d3-c67c3dfaf9e2 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:05.158252 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-aa0aa061-4671-47a3-b0d3-c67c3dfaf9e2 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:05.158412 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-2dfc74d0-276b-4cd6-b4b2-db178f7ca9c1 req-8b8a5aad-959f-49fe-9302-d4720f14e9b1 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:05.159051 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-2dfc74d0-276b-4cd6-b4b2-db178f7ca9c1 req-8b8a5aad-959f-49fe-9302-d4720f14e9b1 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:05.159226 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-aa0aa061-4671-47a3-b0d3-c67c3dfaf9e2 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:05.159492 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-aa0aa061-4671-47a3-b0d3-c67c3dfaf9e2 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:05.170439 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-2dfc74d0-276b-4cd6-b4b2-db178f7ca9c1 req-8b8a5aad-959f-49fe-9302-d4720f14e9b1 service nova] Creating event network-vif-plugged:ac9d083a-77d7-4d9d-a0ea-ee7b9f6e3aab for instance 67b3164b-4fb1-4812-94b7-cc60b3040700 on hv-cinder-85127 Aug 03 05:18:05.176919 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-2dfc74d0-276b-4cd6-b4b2-db178f7ca9c1 req-8b8a5aad-959f-49fe-9302-d4720f14e9b1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033341 Aug 03 05:18:05.177529 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 353/671] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:18:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:18:05.236660 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-f6a76075-cac3-4ca0-9634-549324319860 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:05.236970 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-f6a76075-cac3-4ca0-9634-549324319860 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: ddb3fb62-23ee-4e46-b198-e30b98687d24] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:05.243253 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f6a76075-cac3-4ca0-9634-549324319860 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:05.243706 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f6a76075-cac3-4ca0-9634-549324319860 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:05.244480 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f6a76075-cac3-4ca0-9634-549324319860 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:05.244923 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f6a76075-cac3-4ca0-9634-549324319860 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:05.359873 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-aa0aa061-4671-47a3-b0d3-c67c3dfaf9e2 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:05.368284 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-aa0aa061-4671-47a3-b0d3-c67c3dfaf9e2 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:05.370698 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-aa0aa061-4671-47a3-b0d3-c67c3dfaf9e2 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:05.371928 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-aa0aa061-4671-47a3-b0d3-c67c3dfaf9e2 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 200 len: 1406 microversion: 2.20 time: 0.238237 Aug 03 05:18:05.372583 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 319/672] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:18:05 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 1406 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:18:05.415161 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-f6a76075-cac3-4ca0-9634-549324319860 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:05.422790 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-f6a76075-cac3-4ca0-9634-549324319860 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24" status: 200 len: 1362 microversion: 2.1 time: 0.243874 Aug 03 05:18:05.423398 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 354/673] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:05 2022] GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24 => generated 1362 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:18:06.395511 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-2271a307-6569-47f1-a3ed-35d08790dd71 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:06.396117 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-2271a307-6569-47f1-a3ed-35d08790dd71 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:06.403654 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-2271a307-6569-47f1-a3ed-35d08790dd71 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:06.404108 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-2271a307-6569-47f1-a3ed-35d08790dd71 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:06.404857 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-2271a307-6569-47f1-a3ed-35d08790dd71 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:06.405289 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-2271a307-6569-47f1-a3ed-35d08790dd71 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:06.444454 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-5289dd97-09d4-456a-aee3-d412f710ccd7 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:06.445069 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-5289dd97-09d4-456a-aee3-d412f710ccd7 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: ddb3fb62-23ee-4e46-b198-e30b98687d24] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:06.451634 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5289dd97-09d4-456a-aee3-d412f710ccd7 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:06.452096 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5289dd97-09d4-456a-aee3-d412f710ccd7 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:06.452883 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5289dd97-09d4-456a-aee3-d412f710ccd7 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:06.453330 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5289dd97-09d4-456a-aee3-d412f710ccd7 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:06.604744 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-2271a307-6569-47f1-a3ed-35d08790dd71 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:06.613632 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-2271a307-6569-47f1-a3ed-35d08790dd71 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:06.615187 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-2271a307-6569-47f1-a3ed-35d08790dd71 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:06.616299 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-2271a307-6569-47f1-a3ed-35d08790dd71 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 200 len: 1406 microversion: 2.20 time: 0.225060 Aug 03 05:18:06.616935 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 320/674] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:18:06 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 1406 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:18:06.635568 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-5289dd97-09d4-456a-aee3-d412f710ccd7 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:06.643088 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-5289dd97-09d4-456a-aee3-d412f710ccd7 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24" status: 200 len: 1362 microversion: 2.1 time: 0.202282 Aug 03 05:18:06.644000 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 355/675] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:06 2022] GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24 => generated 1362 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:18:07.190771 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [req-6b6bafa5-3e1b-44b6-83f5-a2abb86dfe61 req-199c5337-fffa-4ca2-9722-01626b686037 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddb3fb62-23ee-4e46-b198-e30b98687d24", "name": "network-vif-plugged", "status": "completed", "tag": "295bab3a-078d-47dd-a131-28f87fd072a1"}]} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:18:07.200798 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-6b6bafa5-3e1b-44b6-83f5-a2abb86dfe61 req-199c5337-fffa-4ca2-9722-01626b686037 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:07.201243 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-6b6bafa5-3e1b-44b6-83f5-a2abb86dfe61 req-199c5337-fffa-4ca2-9722-01626b686037 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:07.212600 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.compute.server_external_events [req-6b6bafa5-3e1b-44b6-83f5-a2abb86dfe61 req-199c5337-fffa-4ca2-9722-01626b686037 service nova] Creating event network-vif-plugged:295bab3a-078d-47dd-a131-28f87fd072a1 for instance ddb3fb62-23ee-4e46-b198-e30b98687d24 on hv-cinder-85127 Aug 03 05:18:07.218194 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [req-6b6bafa5-3e1b-44b6-83f5-a2abb86dfe61 req-199c5337-fffa-4ca2-9722-01626b686037 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031307 Aug 03 05:18:07.218777 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 321/676] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:18:07.640071 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-66c095e2-b4c6-458d-99fa-be1eeb8af423 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:07.640793 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-66c095e2-b4c6-458d-99fa-be1eeb8af423 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:07.647643 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-66c095e2-b4c6-458d-99fa-be1eeb8af423 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:07.648119 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-66c095e2-b4c6-458d-99fa-be1eeb8af423 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:07.648885 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-66c095e2-b4c6-458d-99fa-be1eeb8af423 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:07.649321 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-66c095e2-b4c6-458d-99fa-be1eeb8af423 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:07.666298 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-94d1babd-dcca-4ff8-81f5-e85de95e9ad4 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:07.667172 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-94d1babd-dcca-4ff8-81f5-e85de95e9ad4 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: ddb3fb62-23ee-4e46-b198-e30b98687d24] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:07.675060 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-94d1babd-dcca-4ff8-81f5-e85de95e9ad4 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:07.675522 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-94d1babd-dcca-4ff8-81f5-e85de95e9ad4 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:07.678307 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-94d1babd-dcca-4ff8-81f5-e85de95e9ad4 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:07.678768 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-94d1babd-dcca-4ff8-81f5-e85de95e9ad4 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:07.864230 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-66c095e2-b4c6-458d-99fa-be1eeb8af423 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:07.866971 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-94d1babd-dcca-4ff8-81f5-e85de95e9ad4 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:07.873274 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-66c095e2-b4c6-458d-99fa-be1eeb8af423 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:07.874889 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-66c095e2-b4c6-458d-99fa-be1eeb8af423 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:07.875150 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-94d1babd-dcca-4ff8-81f5-e85de95e9ad4 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24" status: 200 len: 1362 microversion: 2.1 time: 0.213563 Aug 03 05:18:07.875732 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 322/677] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:07 2022] GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24 => generated 1362 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:18:07.876010 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-66c095e2-b4c6-458d-99fa-be1eeb8af423 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 200 len: 1406 microversion: 2.20 time: 0.240550 Aug 03 05:18:07.876634 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 356/678] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:18:07 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 1406 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:18:08.866563 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-8449c9b4-ffb2-46e4-9028-2ae08531a26f tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:08.867104 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-8449c9b4-ffb2-46e4-9028-2ae08531a26f tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:08.874036 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-8449c9b4-ffb2-46e4-9028-2ae08531a26f tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:08.874492 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-8449c9b4-ffb2-46e4-9028-2ae08531a26f tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:08.875288 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-8449c9b4-ffb2-46e4-9028-2ae08531a26f tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:08.875730 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-8449c9b4-ffb2-46e4-9028-2ae08531a26f tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:08.895682 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-031322e4-e5ec-4101-be12-7363d5e9fb43 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:08.896312 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-031322e4-e5ec-4101-be12-7363d5e9fb43 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: ddb3fb62-23ee-4e46-b198-e30b98687d24] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:08.902719 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-031322e4-e5ec-4101-be12-7363d5e9fb43 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:08.903228 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-031322e4-e5ec-4101-be12-7363d5e9fb43 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:08.904011 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-031322e4-e5ec-4101-be12-7363d5e9fb43 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:08.904451 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-031322e4-e5ec-4101-be12-7363d5e9fb43 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:08.956212 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.objects.instance [None req-8449c9b4-ffb2-46e4-9028-2ae08531a26f tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lazy-loading 'services' on Instance uuid 54dba69b-6ed5-4aff-91cb-3a98e09680d7 {{(pid=118332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:18:09.035016 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-031322e4-e5ec-4101-be12-7363d5e9fb43 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:09.042386 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-031322e4-e5ec-4101-be12-7363d5e9fb43 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24" status: 200 len: 1362 microversion: 2.1 time: 0.150515 Aug 03 05:18:09.042964 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 357/679] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:08 2022] GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:18:09.048991 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-743ea77d-d084-4609-9775-6775b3fa8c48 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:09.048991 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-743ea77d-d084-4609-9775-6775b3fa8c48 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:09.053294 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-743ea77d-d084-4609-9775-6775b3fa8c48 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:09.053750 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-743ea77d-d084-4609-9775-6775b3fa8c48 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:09.054499 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-743ea77d-d084-4609-9775-6775b3fa8c48 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:09.054961 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-743ea77d-d084-4609-9775-6775b3fa8c48 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:09.161368 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-8449c9b4-ffb2-46e4-9028-2ae08531a26f tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "DELETE /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7/os-volume_attachments/2f946b6e-7213-470a-a9a1-0a1110fd5385" status: 202 len: 0 microversion: 2.1 time: 0.298557 Aug 03 05:18:09.161995 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 323/680] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Aug 3 05:18:08 2022] DELETE /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7/os-volume_attachments/2f946b6e-7213-470a-a9a1-0a1110fd5385 => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:18:09.171364 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-72c3bf25-51ec-443a-b159-d912431885a0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:09.173933 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-72c3bf25-51ec-443a-b159-d912431885a0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:09.180564 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-72c3bf25-51ec-443a-b159-d912431885a0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:09.181113 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-72c3bf25-51ec-443a-b159-d912431885a0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:09.181894 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-72c3bf25-51ec-443a-b159-d912431885a0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:09.182336 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-72c3bf25-51ec-443a-b159-d912431885a0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:09.189960 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-743ea77d-d084-4609-9775-6775b3fa8c48 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:09.198454 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-743ea77d-d084-4609-9775-6775b3fa8c48 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:09.200593 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-743ea77d-d084-4609-9775-6775b3fa8c48 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:09.201708 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-743ea77d-d084-4609-9775-6775b3fa8c48 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 200 len: 1406 microversion: 2.20 time: 0.157806 Aug 03 05:18:09.202986 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 358/681] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:18:09 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:18:09.216421 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-72c3bf25-51ec-443a-b159-d912431885a0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049707 Aug 03 05:18:09.216980 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 324/682] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Aug 3 05:18:09 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:18:10.063465 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-cc7385ea-0147-483e-a685-aff37166df59 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:10.064076 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-cc7385ea-0147-483e-a685-aff37166df59 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: ddb3fb62-23ee-4e46-b198-e30b98687d24] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:10.070621 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-cc7385ea-0147-483e-a685-aff37166df59 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:10.071107 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-cc7385ea-0147-483e-a685-aff37166df59 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:10.071875 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-cc7385ea-0147-483e-a685-aff37166df59 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:10.072317 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-cc7385ea-0147-483e-a685-aff37166df59 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:10.200867 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-cc7385ea-0147-483e-a685-aff37166df59 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:10.208395 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-cc7385ea-0147-483e-a685-aff37166df59 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24" status: 200 len: 1362 microversion: 2.1 time: 0.148766 Aug 03 05:18:10.208968 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 359/683] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:10 2022] GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:18:10.225405 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-91f268e2-be7f-46b5-adaf-08420cfa8dcb tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:10.226092 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-91f268e2-be7f-46b5-adaf-08420cfa8dcb tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:10.228026 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-20f72b99-a7b3-48c7-82a9-1d78f002ca05 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:10.230465 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-20f72b99-a7b3-48c7-82a9-1d78f002ca05 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:10.233125 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-91f268e2-be7f-46b5-adaf-08420cfa8dcb tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:10.233814 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-91f268e2-be7f-46b5-adaf-08420cfa8dcb tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:10.234658 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-91f268e2-be7f-46b5-adaf-08420cfa8dcb tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:10.235430 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-91f268e2-be7f-46b5-adaf-08420cfa8dcb tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:10.237272 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-20f72b99-a7b3-48c7-82a9-1d78f002ca05 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:10.237738 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-20f72b99-a7b3-48c7-82a9-1d78f002ca05 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:10.239097 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-20f72b99-a7b3-48c7-82a9-1d78f002ca05 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:10.239297 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-20f72b99-a7b3-48c7-82a9-1d78f002ca05 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:10.285950 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-20f72b99-a7b3-48c7-82a9-1d78f002ca05 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062025 Aug 03 05:18:10.286875 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 360/684] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Aug 3 05:18:10 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:18:10.373353 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-91f268e2-be7f-46b5-adaf-08420cfa8dcb tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:10.381606 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-91f268e2-be7f-46b5-adaf-08420cfa8dcb tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:10.383220 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-91f268e2-be7f-46b5-adaf-08420cfa8dcb tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:10.384386 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-91f268e2-be7f-46b5-adaf-08420cfa8dcb tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 200 len: 1597 microversion: 2.20 time: 0.163077 Aug 03 05:18:10.384957 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 325/685] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:18:10 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 1597 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:18:10.407496 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-a664fb20-f8c5-43af-9d6b-ac43e125ecd6 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:10.407992 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-a664fb20-f8c5-43af-9d6b-ac43e125ecd6 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:10.414735 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a664fb20-f8c5-43af-9d6b-ac43e125ecd6 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:10.415430 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a664fb20-f8c5-43af-9d6b-ac43e125ecd6 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:10.416245 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a664fb20-f8c5-43af-9d6b-ac43e125ecd6 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:10.416741 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a664fb20-f8c5-43af-9d6b-ac43e125ecd6 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:10.497876 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-a664fb20-f8c5-43af-9d6b-ac43e125ecd6 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.094966 Aug 03 05:18:10.498508 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 361/686] 10.222.0.40 () {60 vars in 1316 bytes} [Wed Aug 3 05:18:10 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 05:18:11.229652 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-86a24a72-fc37-4090-bc1b-d36ba0b164a2 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:11.230294 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-86a24a72-fc37-4090-bc1b-d36ba0b164a2 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: ddb3fb62-23ee-4e46-b198-e30b98687d24] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:11.240368 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-86a24a72-fc37-4090-bc1b-d36ba0b164a2 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:11.240986 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-86a24a72-fc37-4090-bc1b-d36ba0b164a2 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:11.241778 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-86a24a72-fc37-4090-bc1b-d36ba0b164a2 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:11.242226 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-86a24a72-fc37-4090-bc1b-d36ba0b164a2 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:11.298635 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-6d6e9835-05a2-47cd-a256-a9718ec30593 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:11.301004 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-6d6e9835-05a2-47cd-a256-a9718ec30593 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:11.307309 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6d6e9835-05a2-47cd-a256-a9718ec30593 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:11.308136 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6d6e9835-05a2-47cd-a256-a9718ec30593 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:11.310251 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6d6e9835-05a2-47cd-a256-a9718ec30593 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:11.310251 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6d6e9835-05a2-47cd-a256-a9718ec30593 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:11.344969 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-6d6e9835-05a2-47cd-a256-a9718ec30593 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049984 Aug 03 05:18:11.348649 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 362/687] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Aug 3 05:18:11 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:18:11.400516 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-86a24a72-fc37-4090-bc1b-d36ba0b164a2 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:11.408488 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-86a24a72-fc37-4090-bc1b-d36ba0b164a2 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24" status: 200 len: 1362 microversion: 2.1 time: 0.182709 Aug 03 05:18:11.409078 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 326/688] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:11 2022] GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24 => generated 1362 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:18:11.742423 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-bc870656-5bf3-43e0-8b3e-2e02315e6ce7 req-f975fd97-8067-4157-9e93-52dcdc346741 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67b3164b-4fb1-4812-94b7-cc60b3040700", "tag": "ac9d083a-77d7-4d9d-a0ea-ee7b9f6e3aab"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:18:11.755307 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-bc870656-5bf3-43e0-8b3e-2e02315e6ce7 req-f975fd97-8067-4157-9e93-52dcdc346741 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:11.755744 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-bc870656-5bf3-43e0-8b3e-2e02315e6ce7 req-f975fd97-8067-4157-9e93-52dcdc346741 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:11.768196 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-bc870656-5bf3-43e0-8b3e-2e02315e6ce7 req-f975fd97-8067-4157-9e93-52dcdc346741 service nova] Creating event network-changed:ac9d083a-77d7-4d9d-a0ea-ee7b9f6e3aab for instance 67b3164b-4fb1-4812-94b7-cc60b3040700 on hv-cinder-85127 Aug 03 05:18:11.773183 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-bc870656-5bf3-43e0-8b3e-2e02315e6ce7 req-f975fd97-8067-4157-9e93-52dcdc346741 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034390 Aug 03 05:18:11.773859 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 363/689] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:18:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:18:12.356219 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-90adb799-4d0d-4ed5-b5d9-13f134400e75 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:12.358457 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-90adb799-4d0d-4ed5-b5d9-13f134400e75 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:12.365033 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-90adb799-4d0d-4ed5-b5d9-13f134400e75 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:12.365491 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-90adb799-4d0d-4ed5-b5d9-13f134400e75 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:12.366275 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-90adb799-4d0d-4ed5-b5d9-13f134400e75 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:12.366716 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-90adb799-4d0d-4ed5-b5d9-13f134400e75 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:12.400721 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-90adb799-4d0d-4ed5-b5d9-13f134400e75 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048346 Aug 03 05:18:12.401336 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 327/690] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Aug 3 05:18:12 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:18:12.430273 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-822fb884-f097-4049-bc13-c5a364f76253 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:12.430975 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-822fb884-f097-4049-bc13-c5a364f76253 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: ddb3fb62-23ee-4e46-b198-e30b98687d24] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:12.438001 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-822fb884-f097-4049-bc13-c5a364f76253 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:12.438456 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-822fb884-f097-4049-bc13-c5a364f76253 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:12.439262 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-822fb884-f097-4049-bc13-c5a364f76253 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:12.439727 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-822fb884-f097-4049-bc13-c5a364f76253 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:12.585524 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-822fb884-f097-4049-bc13-c5a364f76253 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:12.597622 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-822fb884-f097-4049-bc13-c5a364f76253 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24" status: 200 len: 1362 microversion: 2.1 time: 0.171562 Aug 03 05:18:12.598219 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 364/691] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:12 2022] GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24 => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:18:13.414023 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-5c49a15c-284f-49e2-973d-c6cd00c3792c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:13.416211 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-5c49a15c-284f-49e2-973d-c6cd00c3792c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:13.423926 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-5c49a15c-284f-49e2-973d-c6cd00c3792c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:13.424380 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-5c49a15c-284f-49e2-973d-c6cd00c3792c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:13.425157 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-5c49a15c-284f-49e2-973d-c6cd00c3792c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:13.425640 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-5c49a15c-284f-49e2-973d-c6cd00c3792c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:13.453819 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-5c49a15c-284f-49e2-973d-c6cd00c3792c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043863 Aug 03 05:18:13.454381 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 328/692] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Aug 3 05:18:13 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:18:13.620804 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-74619912-7be0-457e-afbd-676abe117a5d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:13.621480 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-74619912-7be0-457e-afbd-676abe117a5d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: ddb3fb62-23ee-4e46-b198-e30b98687d24] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:13.628614 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-74619912-7be0-457e-afbd-676abe117a5d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:13.629098 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-74619912-7be0-457e-afbd-676abe117a5d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:13.629865 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-74619912-7be0-457e-afbd-676abe117a5d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:13.630306 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-74619912-7be0-457e-afbd-676abe117a5d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:13.758659 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-74619912-7be0-457e-afbd-676abe117a5d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:13.766544 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-74619912-7be0-457e-afbd-676abe117a5d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24" status: 200 len: 1362 microversion: 2.1 time: 0.149666 Aug 03 05:18:13.767151 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 365/693] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:13 2022] GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:18:14.466151 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-29af3d88-33bf-4896-be2c-3966c0b5211d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:14.468362 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-29af3d88-33bf-4896-be2c-3966c0b5211d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:14.475177 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-29af3d88-33bf-4896-be2c-3966c0b5211d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:14.475665 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-29af3d88-33bf-4896-be2c-3966c0b5211d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:14.476451 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-29af3d88-33bf-4896-be2c-3966c0b5211d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:14.476890 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-29af3d88-33bf-4896-be2c-3966c0b5211d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:14.506744 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-29af3d88-33bf-4896-be2c-3966c0b5211d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044563 Aug 03 05:18:14.507347 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 329/694] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Aug 3 05:18:14 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 05:18:14.596018 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-db19a5d4-675f-4d91-80c4-b3c9198bb934 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:14.596461 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-db19a5d4-675f-4d91-80c4-b3c9198bb934 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:14.602670 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-db19a5d4-675f-4d91-80c4-b3c9198bb934 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:14.603162 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-db19a5d4-675f-4d91-80c4-b3c9198bb934 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:14.603942 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-db19a5d4-675f-4d91-80c4-b3c9198bb934 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:14.604389 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-db19a5d4-675f-4d91-80c4-b3c9198bb934 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:14.630983 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-db19a5d4-675f-4d91-80c4-b3c9198bb934 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Going to try to terminate instance {{(pid=118331) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:18:14.791227 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-72eadb23-ebe5-45ac-881f-0cb314165ece tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:14.791859 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-72eadb23-ebe5-45ac-881f-0cb314165ece tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: ddb3fb62-23ee-4e46-b198-e30b98687d24] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:14.798321 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-72eadb23-ebe5-45ac-881f-0cb314165ece tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:14.798770 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-72eadb23-ebe5-45ac-881f-0cb314165ece tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:14.799560 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-72eadb23-ebe5-45ac-881f-0cb314165ece tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:14.799995 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-72eadb23-ebe5-45ac-881f-0cb314165ece tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:14.881780 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-db19a5d4-675f-4d91-80c4-b3c9198bb934 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "DELETE /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7" status: 204 len: 0 microversion: 2.1 time: 0.290057 Aug 03 05:18:14.882420 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 366/695] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Aug 3 05:18:14 2022] DELETE /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:18:14.891199 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-f9c9eef0-e623-4cce-a9c8-0f9be2560a42 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:14.891985 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-f9c9eef0-e623-4cce-a9c8-0f9be2560a42 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:14.898037 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f9c9eef0-e623-4cce-a9c8-0f9be2560a42 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:14.898491 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f9c9eef0-e623-4cce-a9c8-0f9be2560a42 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:14.899395 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f9c9eef0-e623-4cce-a9c8-0f9be2560a42 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:14.899862 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f9c9eef0-e623-4cce-a9c8-0f9be2560a42 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:14.930876 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-72eadb23-ebe5-45ac-881f-0cb314165ece tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:14.938649 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-72eadb23-ebe5-45ac-881f-0cb314165ece tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24" status: 200 len: 1362 microversion: 2.1 time: 0.151195 Aug 03 05:18:14.939268 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 330/696] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:14 2022] GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:18:15.029920 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-f9c9eef0-e623-4cce-a9c8-0f9be2560a42 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:15.032249 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:18:15.038156 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-f9c9eef0-e623-4cce-a9c8-0f9be2560a42 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7" status: 200 len: 1687 microversion: 2.1 time: 0.151624 Aug 03 05:18:15.044103 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 367/697] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:14 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7 => generated 1687 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:18:15.960092 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-f7b41e6f-19bf-4ccf-98d7-ff110f995cbf tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:15.960872 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-f7b41e6f-19bf-4ccf-98d7-ff110f995cbf tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: ddb3fb62-23ee-4e46-b198-e30b98687d24] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:15.967377 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f7b41e6f-19bf-4ccf-98d7-ff110f995cbf tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:15.967835 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f7b41e6f-19bf-4ccf-98d7-ff110f995cbf tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:15.968603 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f7b41e6f-19bf-4ccf-98d7-ff110f995cbf tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:15.969047 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f7b41e6f-19bf-4ccf-98d7-ff110f995cbf tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:16.064099 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-9ab6a9eb-6333-4929-826c-391867084f5d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:16.064708 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-9ab6a9eb-6333-4929-826c-391867084f5d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:16.071628 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9ab6a9eb-6333-4929-826c-391867084f5d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:16.072079 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9ab6a9eb-6333-4929-826c-391867084f5d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:16.072848 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9ab6a9eb-6333-4929-826c-391867084f5d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:16.073282 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9ab6a9eb-6333-4929-826c-391867084f5d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:16.103682 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-f7b41e6f-19bf-4ccf-98d7-ff110f995cbf tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:16.111949 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-f7b41e6f-19bf-4ccf-98d7-ff110f995cbf tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24" status: 200 len: 1547 microversion: 2.1 time: 0.155750 Aug 03 05:18:16.112545 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 331/698] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:15 2022] GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24 => generated 1547 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:18:16.133621 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-0748d681-041e-4a22-8fcd-d55accf12b88 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:16.134118 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-0748d681-041e-4a22-8fcd-d55accf12b88 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: ddb3fb62-23ee-4e46-b198-e30b98687d24] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:16.140340 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-0748d681-041e-4a22-8fcd-d55accf12b88 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:16.140796 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-0748d681-041e-4a22-8fcd-d55accf12b88 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:16.141579 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-0748d681-041e-4a22-8fcd-d55accf12b88 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:16.142023 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-0748d681-041e-4a22-8fcd-d55accf12b88 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:16.241113 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-0748d681-041e-4a22-8fcd-d55accf12b88 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.111361 Aug 03 05:18:16.241757 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 332/699] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Aug 3 05:18:16 2022] GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24/os-interface => generated 284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:18:16.245936 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-9ab6a9eb-6333-4929-826c-391867084f5d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:16.256862 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-9ab6a9eb-6333-4929-826c-391867084f5d tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7" status: 200 len: 1687 microversion: 2.1 time: 0.196836 Aug 03 05:18:16.257505 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 368/700] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:16 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7 => generated 1687 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:18:17.278435 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-0c59e052-a141-42a6-b699-2f31bca582c9 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:17.279260 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-0c59e052-a141-42a6-b699-2f31bca582c9 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:17.286280 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-0c59e052-a141-42a6-b699-2f31bca582c9 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:17.286904 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-0c59e052-a141-42a6-b699-2f31bca582c9 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:17.287947 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-0c59e052-a141-42a6-b699-2f31bca582c9 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:17.288581 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-0c59e052-a141-42a6-b699-2f31bca582c9 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:17.570085 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-9fd65481-1ac8-47cd-a9f9-957c847f7c5a req-117cd71a-e98a-4103-a05a-d8d93158177a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddb3fb62-23ee-4e46-b198-e30b98687d24", "tag": "295bab3a-078d-47dd-a131-28f87fd072a1"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:18:17.580416 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-9fd65481-1ac8-47cd-a9f9-957c847f7c5a req-117cd71a-e98a-4103-a05a-d8d93158177a service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:17.580859 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-9fd65481-1ac8-47cd-a9f9-957c847f7c5a req-117cd71a-e98a-4103-a05a-d8d93158177a service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:17.593258 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-9fd65481-1ac8-47cd-a9f9-957c847f7c5a req-117cd71a-e98a-4103-a05a-d8d93158177a service nova] Creating event network-changed:295bab3a-078d-47dd-a131-28f87fd072a1 for instance ddb3fb62-23ee-4e46-b198-e30b98687d24 on hv-cinder-85127 Aug 03 05:18:17.598286 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-9fd65481-1ac8-47cd-a9f9-957c847f7c5a req-117cd71a-e98a-4103-a05a-d8d93158177a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031951 Aug 03 05:18:17.599140 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 369/701] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:18:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:18:17.631785 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-0c59e052-a141-42a6-b699-2f31bca582c9 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:17.640983 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-0c59e052-a141-42a6-b699-2f31bca582c9 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7" status: 200 len: 1687 microversion: 2.1 time: 0.367082 Aug 03 05:18:17.641575 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 333/702] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:17 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7 => generated 1687 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:18:18.663929 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-95990dd0-86e5-4ae5-9291-e85fbbdeb6ba tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:18.664619 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-95990dd0-86e5-4ae5-9291-e85fbbdeb6ba tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:18.671718 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-95990dd0-86e5-4ae5-9291-e85fbbdeb6ba tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:18.672174 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-95990dd0-86e5-4ae5-9291-e85fbbdeb6ba tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:18.672948 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-95990dd0-86e5-4ae5-9291-e85fbbdeb6ba tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:18.673391 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-95990dd0-86e5-4ae5-9291-e85fbbdeb6ba tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:18.806765 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-95990dd0-86e5-4ae5-9291-e85fbbdeb6ba tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:18.814605 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-95990dd0-86e5-4ae5-9291-e85fbbdeb6ba tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7" status: 200 len: 1687 microversion: 2.1 time: 0.155400 Aug 03 05:18:18.816268 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 370/703] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:18 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7 => generated 1687 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:18:19.141341 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-c81a58c6-a83a-47fd-8f6b-8fb3437795c3 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:19.141947 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-c81a58c6-a83a-47fd-8f6b-8fb3437795c3 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] [instance: de47a5df-467d-41d2-ac4a-80d31da9a602] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:19.148792 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-c81a58c6-a83a-47fd-8f6b-8fb3437795c3 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:19.149326 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-c81a58c6-a83a-47fd-8f6b-8fb3437795c3 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:19.150176 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-c81a58c6-a83a-47fd-8f6b-8fb3437795c3 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:19.150690 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-c81a58c6-a83a-47fd-8f6b-8fb3437795c3 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:19.234495 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.objects.instance [None req-c81a58c6-a83a-47fd-8f6b-8fb3437795c3 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lazy-loading 'services' on Instance uuid de47a5df-467d-41d2-ac4a-80d31da9a602 {{(pid=118332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:18:19.468835 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-c81a58c6-a83a-47fd-8f6b-8fb3437795c3 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] 10.222.0.40 "DELETE /compute/v2.1/servers/de47a5df-467d-41d2-ac4a-80d31da9a602/os-volume_attachments/a251912b-3c39-4778-8f84-19b10565ee1e" status: 202 len: 0 microversion: 2.1 time: 0.331946 Aug 03 05:18:19.470058 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 334/704] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Aug 3 05:18:19 2022] DELETE /compute/v2.1/servers/de47a5df-467d-41d2-ac4a-80d31da9a602/os-volume_attachments/a251912b-3c39-4778-8f84-19b10565ee1e => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 05:18:19.839078 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-6fcd4c74-07c3-4b23-8cf8-e26bb76aee77 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:19.841484 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-6fcd4c74-07c3-4b23-8cf8-e26bb76aee77 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:19.849872 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6fcd4c74-07c3-4b23-8cf8-e26bb76aee77 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:19.850331 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6fcd4c74-07c3-4b23-8cf8-e26bb76aee77 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:19.851244 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6fcd4c74-07c3-4b23-8cf8-e26bb76aee77 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:19.851619 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6fcd4c74-07c3-4b23-8cf8-e26bb76aee77 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:19.923549 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-6fcd4c74-07c3-4b23-8cf8-e26bb76aee77 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:19.931397 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-6fcd4c74-07c3-4b23-8cf8-e26bb76aee77 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7" status: 200 len: 1620 microversion: 2.1 time: 0.096476 Aug 03 05:18:19.931961 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 371/705] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:19 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7 => generated 1620 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:18:20.230798 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [req-7bc651be-4abd-41ce-a82d-fbef6519646d req-7b3aeb07-90a8-4d4a-9bc2-c0e935a436bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54dba69b-6ed5-4aff-91cb-3a98e09680d7", "name": "network-vif-deleted", "tag": "961b2cd9-c56a-4c39-8446-8f00f4de31f0"}]} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:18:20.244880 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-7bc651be-4abd-41ce-a82d-fbef6519646d req-7b3aeb07-90a8-4d4a-9bc2-c0e935a436bd service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:20.246053 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-7bc651be-4abd-41ce-a82d-fbef6519646d req-7b3aeb07-90a8-4d4a-9bc2-c0e935a436bd service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:20.251410 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:18:20.262337 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.compute.server_external_events [req-7bc651be-4abd-41ce-a82d-fbef6519646d req-7b3aeb07-90a8-4d4a-9bc2-c0e935a436bd service nova] Creating event network-vif-deleted:961b2cd9-c56a-4c39-8446-8f00f4de31f0 for instance 54dba69b-6ed5-4aff-91cb-3a98e09680d7 on hv-cinder-85127 Aug 03 05:18:20.269060 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [req-7bc651be-4abd-41ce-a82d-fbef6519646d req-7b3aeb07-90a8-4d4a-9bc2-c0e935a436bd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105059 Aug 03 05:18:20.270218 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 335/706] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:18:20.597618 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-0b004b75-6061-4146-af33-db770bc402ab tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:20.598318 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-0b004b75-6061-4146-af33-db770bc402ab tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] [instance: de47a5df-467d-41d2-ac4a-80d31da9a602] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:20.604616 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0b004b75-6061-4146-af33-db770bc402ab tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:20.605597 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0b004b75-6061-4146-af33-db770bc402ab tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:20.606377 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0b004b75-6061-4146-af33-db770bc402ab tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:20.606819 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0b004b75-6061-4146-af33-db770bc402ab tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:20.632321 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-0b004b75-6061-4146-af33-db770bc402ab tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] [instance: de47a5df-467d-41d2-ac4a-80d31da9a602] Going to try to terminate instance {{(pid=118331) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:18:20.955900 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-3c3edc18-6276-4f26-a3fd-7ca848226347 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:20.956611 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-3c3edc18-6276-4f26-a3fd-7ca848226347 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:20.963750 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3c3edc18-6276-4f26-a3fd-7ca848226347 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:20.982361 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3c3edc18-6276-4f26-a3fd-7ca848226347 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:20.982361 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3c3edc18-6276-4f26-a3fd-7ca848226347 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:20.982361 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3c3edc18-6276-4f26-a3fd-7ca848226347 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:20.999452 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3c3edc18-6276-4f26-a3fd-7ca848226347 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:21.000505 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3c3edc18-6276-4f26-a3fd-7ca848226347 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:21.000635 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-0b004b75-6061-4146-af33-db770bc402ab tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] 10.222.0.40 "DELETE /compute/v2.1/servers/de47a5df-467d-41d2-ac4a-80d31da9a602" status: 204 len: 0 microversion: 2.1 time: 0.406174 Aug 03 05:18:21.001890 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 372/707] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Aug 3 05:18:20 2022] DELETE /compute/v2.1/servers/de47a5df-467d-41d2-ac4a-80d31da9a602 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:18:21.003179 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.objects.instance [None req-3c3edc18-6276-4f26-a3fd-7ca848226347 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lazy-loading 'fault' on Instance uuid 54dba69b-6ed5-4aff-91cb-3a98e09680d7 {{(pid=118332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:18:21.011944 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-e8418f2c-7468-4513-882d-f5116a5f160e tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:21.012824 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-e8418f2c-7468-4513-882d-f5116a5f160e tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] [instance: de47a5df-467d-41d2-ac4a-80d31da9a602] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:21.019374 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e8418f2c-7468-4513-882d-f5116a5f160e tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:21.019960 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e8418f2c-7468-4513-882d-f5116a5f160e tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:21.020926 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e8418f2c-7468-4513-882d-f5116a5f160e tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:21.021370 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e8418f2c-7468-4513-882d-f5116a5f160e tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:21.055836 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-3c3edc18-6276-4f26-a3fd-7ca848226347 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:21.064616 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-3c3edc18-6276-4f26-a3fd-7ca848226347 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7" status: 200 len: 1334 microversion: 2.1 time: 0.114950 Aug 03 05:18:21.065472 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 336/708] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:20 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7 => generated 1334 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:18:21.164629 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-e8418f2c-7468-4513-882d-f5116a5f160e tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7d91983dc4c0fb218e7bdbc1c6558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6675985e19c44dabb624420aaa97b0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:21.172221 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-e8418f2c-7468-4513-882d-f5116a5f160e tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] 10.222.0.40 "GET /compute/v2.1/servers/de47a5df-467d-41d2-ac4a-80d31da9a602" status: 200 len: 1513 microversion: 2.1 time: 0.165560 Aug 03 05:18:21.172791 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 373/709] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:21 2022] GET /compute/v2.1/servers/de47a5df-467d-41d2-ac4a-80d31da9a602 => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:18:22.086873 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-54ee5194-96b4-44b8-b800-10dd64b53c2c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:22.087500 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-54ee5194-96b4-44b8-b800-10dd64b53c2c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:22.094607 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-54ee5194-96b4-44b8-b800-10dd64b53c2c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:22.095098 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-54ee5194-96b4-44b8-b800-10dd64b53c2c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:22.095871 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-54ee5194-96b4-44b8-b800-10dd64b53c2c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:22.096317 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-54ee5194-96b4-44b8-b800-10dd64b53c2c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:22.126441 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-54ee5194-96b4-44b8-b800-10dd64b53c2c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:22.126913 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-54ee5194-96b4-44b8-b800-10dd64b53c2c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:22.127370 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.objects.instance [None req-54ee5194-96b4-44b8-b800-10dd64b53c2c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lazy-loading 'fault' on Instance uuid 54dba69b-6ed5-4aff-91cb-3a98e09680d7 {{(pid=118332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:18:22.167982 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-54ee5194-96b4-44b8-b800-10dd64b53c2c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:22.175797 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-54ee5194-96b4-44b8-b800-10dd64b53c2c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7" status: 200 len: 1334 microversion: 2.1 time: 0.093185 Aug 03 05:18:22.176368 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 337/710] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:22 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7 => generated 1334 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:18:22.194287 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-1d4e7fbb-65d0-4887-923c-50834727ddf1 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:22.194834 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-1d4e7fbb-65d0-4887-923c-50834727ddf1 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] [instance: de47a5df-467d-41d2-ac4a-80d31da9a602] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:22.201929 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1d4e7fbb-65d0-4887-923c-50834727ddf1 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:22.202384 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1d4e7fbb-65d0-4887-923c-50834727ddf1 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:22.203207 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1d4e7fbb-65d0-4887-923c-50834727ddf1 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:22.203653 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1d4e7fbb-65d0-4887-923c-50834727ddf1 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:22.337039 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-1d4e7fbb-65d0-4887-923c-50834727ddf1 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7d91983dc4c0fb218e7bdbc1c6558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6675985e19c44dabb624420aaa97b0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:22.345142 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-1d4e7fbb-65d0-4887-923c-50834727ddf1 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] 10.222.0.40 "GET /compute/v2.1/servers/de47a5df-467d-41d2-ac4a-80d31da9a602" status: 200 len: 1513 microversion: 2.1 time: 0.154742 Aug 03 05:18:22.345713 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 374/711] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:22 2022] GET /compute/v2.1/servers/de47a5df-467d-41d2-ac4a-80d31da9a602 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:18:23.197263 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-f0b96f69-d3ce-4676-9cf0-98d1f93c12e0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:23.197807 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-f0b96f69-d3ce-4676-9cf0-98d1f93c12e0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 54dba69b-6ed5-4aff-91cb-3a98e09680d7] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:23.205420 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f0b96f69-d3ce-4676-9cf0-98d1f93c12e0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:23.205626 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f0b96f69-d3ce-4676-9cf0-98d1f93c12e0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:23.206439 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f0b96f69-d3ce-4676-9cf0-98d1f93c12e0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:23.206904 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f0b96f69-d3ce-4676-9cf0-98d1f93c12e0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:23.220626 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.wsgi [None req-f0b96f69-d3ce-4676-9cf0-98d1f93c12e0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] HTTP exception thrown: Instance 54dba69b-6ed5-4aff-91cb-3a98e09680d7 could not be found. Aug 03 05:18:23.222329 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-f0b96f69-d3ce-4676-9cf0-98d1f93c12e0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Request method failure captured: Aug 03 05:18:23.222329 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: request: GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7 HTTP/1.1 Aug 03 05:18:23.222329 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Accept: application/json Aug 03 05:18:23.222329 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Accept-Encoding: identity Aug 03 05:18:23.222329 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Connection: close Aug 03 05:18:23.222329 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Content-Length: 0 Aug 03 05:18:23.222329 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Content-Type: application/json Aug 03 05:18:23.222329 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Host: 10.222.0.40 Aug 03 05:18:23.222329 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Openstack-System-Scope: None Aug 03 05:18:23.222329 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: User-Agent: python-urllib3/1.26.10 Aug 03 05:18:23.222329 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Auth-Token: gAAAAABi6gPTVv1oE_O2DS7JexgjiVZZ5yTvwFfTDvv3fgwnZVMm1QuvOqQPlPZjdlHsUhwyK7cAnIGz147fLocUeEXFYRmV5CkqTfDI-9PO3MxodM9kCsKki6-i9zKuoaKrTaTYSrvfPqxK8YsU3BCLBF7PgTgJHbL8c6JahRaay9047vP40N4 Aug 03 05:18:23.222329 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Domain-Id: None Aug 03 05:18:23.222329 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Domain-Name: None Aug 03 05:18:23.222329 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Identity-Status: Confirmed Aug 03 05:18:23.222329 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Is-Admin-Project: True Aug 03 05:18:23.222329 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Domain-Id: default Aug 03 05:18:23.222329 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Domain-Name: Default Aug 03 05:18:23.222329 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Id: 829c8e80e96d40d682a17185eb4da336 Aug 03 05:18:23.222329 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1128427595 Aug 03 05:18:23.222329 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Role: member,reader Aug 03 05:18:23.222329 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Roles: member,reader Aug 03 05:18:23.224077 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_829c8e80e96d40d682a17185eb4da336"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/829c8e80e96d40d682a17185eb4da336"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/829c8e80e96d40d682a17185eb4da336"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/829c8e80e96d40d682a17185eb4da336"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:18:23.224077 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1128427595 Aug 03 05:18:23.224077 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant-Id: 829c8e80e96d40d682a17185eb4da336 Aug 03 05:18:23.224077 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1128427595 Aug 03 05:18:23.224077 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User: tempest-ServerRescueNegativeTestJSON-1128427595-project Aug 03 05:18:23.224077 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Domain-Id: default Aug 03 05:18:23.224077 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Domain-Name: Default Aug 03 05:18:23.224077 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Id: bb0fe4cb98e0447cad3e126da1a8de9c Aug 03 05:18:23.224077 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1128427595-project Aug 03 05:18:23.224077 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: method: > Aug 03 05:18:23.224077 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: exception: Instance 54dba69b-6ed5-4aff-91cb-3a98e09680d7 could not be found. Aug 03 05:18:23.224077 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: action_args: {'id': '54dba69b-6ed5-4aff-91cb-3a98e09680d7'} Aug 03 05:18:23.224933 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:18:23.224933 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:18:23.224933 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:18:23.224933 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:18:23.224933 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:18:23.224933 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:18:23.224933 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:18:23.224933 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:18:23.224933 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:18:23.224933 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:18:23.224933 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54dba69b-6ed5-4aff-91cb-3a98e09680d7 could not be found. Aug 03 05:18:23.224933 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:18:23.224933 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:18:23.224933 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:18:23.224933 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:18:23.224933 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:18:23.224933 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:18:23.224933 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:18:23.224933 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:18:23.224933 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:18:23.226472 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:18:23.226472 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:18:23.226472 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:18:23.226472 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:18:23.226472 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:18:23.226472 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:18:23.226472 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:18:23.226472 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54dba69b-6ed5-4aff-91cb-3a98e09680d7 could not be found. Aug 03 05:18:23.226472 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:18:23.226472 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:18:23.226472 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:18:23.226472 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:18:23.226472 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:18:23.226472 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:18:23.226472 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:18:23.226472 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:18:23.226472 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54dba69b-6ed5-4aff-91cb-3a98e09680d7 could not be found. Aug 03 05:18:23.226472 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:18:23.235033 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-f0b96f69-d3ce-4676-9cf0-98d1f93c12e0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Returning 404 to user: Instance 54dba69b-6ed5-4aff-91cb-3a98e09680d7 could not be found. {{(pid=118332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:18:23.235033 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-f0b96f69-d3ce-4676-9cf0-98d1f93c12e0 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7" status: 404 len: 111 microversion: 2.1 time: 0.030469 Aug 03 05:18:23.235033 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 338/712] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:23 2022] GET /compute/v2.1/servers/54dba69b-6ed5-4aff-91cb-3a98e09680d7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:18:23.235312 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-d65ff8cb-72dd-44e0-a5f5-0e7d356073bf tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '.version_select at 0x7f7601e598b0>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:23.300395 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-d65ff8cb-72dd-44e0-a5f5-0e7d356073bf tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-992538248" status: 202 len: 0 microversion: 2.1 time: 0.071603 Aug 03 05:18:23.301016 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 375/713] 10.222.0.40 () {58 vars in 1218 bytes} [Wed Aug 3 05:18:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-992538248 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:18:23.366712 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-9d826612-c3a4-4b12-892c-f0562689479d tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:23.372008 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-9d826612-c3a4-4b12-892c-f0562689479d tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] [instance: de47a5df-467d-41d2-ac4a-80d31da9a602] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:23.375531 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-9d826612-c3a4-4b12-892c-f0562689479d tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:23.376248 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-9d826612-c3a4-4b12-892c-f0562689479d tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:23.377272 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-9d826612-c3a4-4b12-892c-f0562689479d tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:23.377928 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-9d826612-c3a4-4b12-892c-f0562689479d tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:23.442646 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-075931eb-e153-46e4-abef-a7dd987a15c7 req-bc44c0aa-8f79-489a-a8c5-25390e340d96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de47a5df-467d-41d2-ac4a-80d31da9a602", "name": "network-vif-deleted", "tag": "1b3364e7-57bb-4ce8-a503-12f0787c7875"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:18:23.452860 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:18:23.456239 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-075931eb-e153-46e4-abef-a7dd987a15c7 req-bc44c0aa-8f79-489a-a8c5-25390e340d96 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:23.456689 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-075931eb-e153-46e4-abef-a7dd987a15c7 req-bc44c0aa-8f79-489a-a8c5-25390e340d96 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:23.471331 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-9d826612-c3a4-4b12-892c-f0562689479d tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d7d91983dc4c0fb218e7bdbc1c6558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6675985e19c44dabb624420aaa97b0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:23.473827 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-075931eb-e153-46e4-abef-a7dd987a15c7 req-bc44c0aa-8f79-489a-a8c5-25390e340d96 service nova] Creating event network-vif-deleted:1b3364e7-57bb-4ce8-a503-12f0787c7875 for instance de47a5df-467d-41d2-ac4a-80d31da9a602 on hv-cinder-85127 Aug 03 05:18:23.480371 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-9d826612-c3a4-4b12-892c-f0562689479d tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] 10.222.0.40 "GET /compute/v2.1/servers/de47a5df-467d-41d2-ac4a-80d31da9a602" status: 200 len: 1471 microversion: 2.1 time: 0.116830 Aug 03 05:18:23.481172 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 339/714] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:23 2022] GET /compute/v2.1/servers/de47a5df-467d-41d2-ac4a-80d31da9a602 => generated 1471 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:18:23.482189 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-075931eb-e153-46e4-abef-a7dd987a15c7 req-bc44c0aa-8f79-489a-a8c5-25390e340d96 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043577 Aug 03 05:18:23.483285 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 376/715] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:18:24.502397 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-5f26b72d-1b29-4604-a685-670c7196b3d6 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:24.503103 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-5f26b72d-1b29-4604-a685-670c7196b3d6 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] [instance: de47a5df-467d-41d2-ac4a-80d31da9a602] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:24.509648 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-5f26b72d-1b29-4604-a685-670c7196b3d6 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:24.510097 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-5f26b72d-1b29-4604-a685-670c7196b3d6 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:24.510925 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-5f26b72d-1b29-4604-a685-670c7196b3d6 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:24.511471 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-5f26b72d-1b29-4604-a685-670c7196b3d6 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:24.524716 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.wsgi [None req-5f26b72d-1b29-4604-a685-670c7196b3d6 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] HTTP exception thrown: Instance de47a5df-467d-41d2-ac4a-80d31da9a602 could not be found. Aug 03 05:18:24.526168 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-5f26b72d-1b29-4604-a685-670c7196b3d6 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Request method failure captured: Aug 03 05:18:24.526168 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: request: GET /compute/v2.1/servers/de47a5df-467d-41d2-ac4a-80d31da9a602 HTTP/1.1 Aug 03 05:18:24.526168 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Accept: application/json Aug 03 05:18:24.526168 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Accept-Encoding: identity Aug 03 05:18:24.526168 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Connection: close Aug 03 05:18:24.526168 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Content-Length: 0 Aug 03 05:18:24.526168 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Content-Type: application/json Aug 03 05:18:24.526168 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Host: 10.222.0.40 Aug 03 05:18:24.526168 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Openstack-System-Scope: None Aug 03 05:18:24.526168 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: User-Agent: python-urllib3/1.26.10 Aug 03 05:18:24.526168 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Auth-Token: gAAAAABi6gSVZztkmfQERKo06yTN6PPOMjbU0gsHKRG89WJxE-BSkslw8hq86KinrZgfJ9RXeUEOTE8Bxs2OWScOxYV3hMiGIlbWBC41fuosxF0ugKN4Ut25ByJloGXzJJEdGc_yyc2HeSN9umQQHq4P7QZKAK4jLcRD-X0HPXI-q1_6vd9sBCs Aug 03 05:18:24.526168 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Domain-Id: None Aug 03 05:18:24.526168 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Domain-Name: None Aug 03 05:18:24.526168 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Identity-Status: Confirmed Aug 03 05:18:24.526168 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Is-Admin-Project: True Aug 03 05:18:24.526168 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Domain-Id: default Aug 03 05:18:24.526168 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Domain-Name: Default Aug 03 05:18:24.526168 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Id: 6675985e19c44dabb624420aaa97b0f7 Aug 03 05:18:24.526168 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Name: tempest-VolumesSnapshotTestJSON-967457277 Aug 03 05:18:24.526168 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Role: member,reader Aug 03 05:18:24.526168 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Roles: member,reader Aug 03 05:18:24.527805 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6675985e19c44dabb624420aaa97b0f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6675985e19c44dabb624420aaa97b0f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6675985e19c44dabb624420aaa97b0f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6675985e19c44dabb624420aaa97b0f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:18:24.527805 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant: tempest-VolumesSnapshotTestJSON-967457277 Aug 03 05:18:24.527805 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant-Id: 6675985e19c44dabb624420aaa97b0f7 Aug 03 05:18:24.527805 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-967457277 Aug 03 05:18:24.527805 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User: tempest-VolumesSnapshotTestJSON-967457277-project Aug 03 05:18:24.527805 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Domain-Id: default Aug 03 05:18:24.527805 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Domain-Name: Default Aug 03 05:18:24.527805 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Id: 28d7d91983dc4c0fb218e7bdbc1c6558 Aug 03 05:18:24.527805 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Name: tempest-VolumesSnapshotTestJSON-967457277-project Aug 03 05:18:24.527805 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: method: > Aug 03 05:18:24.527805 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: exception: Instance de47a5df-467d-41d2-ac4a-80d31da9a602 could not be found. Aug 03 05:18:24.527805 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: action_args: {'id': 'de47a5df-467d-41d2-ac4a-80d31da9a602'} Aug 03 05:18:24.528773 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:18:24.528773 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:18:24.528773 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:18:24.528773 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:18:24.528773 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:18:24.528773 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:18:24.528773 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:18:24.528773 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:18:24.528773 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:18:24.528773 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:18:24.528773 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de47a5df-467d-41d2-ac4a-80d31da9a602 could not be found. Aug 03 05:18:24.528773 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:18:24.528773 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:18:24.528773 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:18:24.528773 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:18:24.528773 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:18:24.528773 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:18:24.528773 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:18:24.528773 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:18:24.528773 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:18:24.530287 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:18:24.530287 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:18:24.530287 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:18:24.530287 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:18:24.530287 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:18:24.530287 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:18:24.530287 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:18:24.530287 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de47a5df-467d-41d2-ac4a-80d31da9a602 could not be found. Aug 03 05:18:24.530287 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:18:24.530287 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:18:24.530287 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:18:24.530287 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:18:24.530287 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:18:24.530287 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:18:24.530287 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:18:24.530287 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:18:24.530287 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de47a5df-467d-41d2-ac4a-80d31da9a602 could not be found. Aug 03 05:18:24.530287 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:18:24.531576 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-5f26b72d-1b29-4604-a685-670c7196b3d6 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] Returning 404 to user: Instance de47a5df-467d-41d2-ac4a-80d31da9a602 could not be found. {{(pid=118332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:18:24.531576 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-5f26b72d-1b29-4604-a685-670c7196b3d6 tempest-VolumesSnapshotTestJSON-967457277 tempest-VolumesSnapshotTestJSON-967457277-project] 10.222.0.40 "GET /compute/v2.1/servers/de47a5df-467d-41d2-ac4a-80d31da9a602" status: 404 len: 111 microversion: 2.1 time: 0.029330 Aug 03 05:18:24.531576 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 340/716] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:24 2022] GET /compute/v2.1/servers/de47a5df-467d-41d2-ac4a-80d31da9a602 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:18:26.626133 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-ff2ee800-2443-4735-a4f5-182815f2c08a tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:26.626727 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-ff2ee800-2443-4735-a4f5-182815f2c08a tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:26.634296 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ff2ee800-2443-4735-a4f5-182815f2c08a tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:26.638516 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ff2ee800-2443-4735-a4f5-182815f2c08a tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:26.638516 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ff2ee800-2443-4735-a4f5-182815f2c08a tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:26.638516 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ff2ee800-2443-4735-a4f5-182815f2c08a tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:26.661673 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-ff2ee800-2443-4735-a4f5-182815f2c08a tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Going to try to terminate instance {{(pid=118331) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:18:26.987959 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-ff2ee800-2443-4735-a4f5-182815f2c08a tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "DELETE /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c" status: 204 len: 0 microversion: 2.1 time: 0.367018 Aug 03 05:18:26.988595 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 377/717] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Aug 3 05:18:26 2022] DELETE /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:18:26.996583 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-b9f29688-aaf1-465d-8a5a-5c63ca9952aa tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:26.997189 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-b9f29688-aaf1-465d-8a5a-5c63ca9952aa tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:26.999664 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_api:SELECT=84 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:18:27.004595 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b9f29688-aaf1-465d-8a5a-5c63ca9952aa tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:27.007896 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b9f29688-aaf1-465d-8a5a-5c63ca9952aa tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:27.007896 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b9f29688-aaf1-465d-8a5a-5c63ca9952aa tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:27.007896 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b9f29688-aaf1-465d-8a5a-5c63ca9952aa tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:27.134280 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-b9f29688-aaf1-465d-8a5a-5c63ca9952aa tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:27.141895 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-b9f29688-aaf1-465d-8a5a-5c63ca9952aa tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c" status: 200 len: 1507 microversion: 2.1 time: 0.149010 Aug 03 05:18:27.142466 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 341/718] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:26 2022] GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:18:28.164260 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-b6531291-d145-4863-9d50-0b7729327a1c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:28.164959 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-b6531291-d145-4863-9d50-0b7729327a1c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:28.171517 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b6531291-d145-4863-9d50-0b7729327a1c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:28.171977 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b6531291-d145-4863-9d50-0b7729327a1c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:28.172742 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b6531291-d145-4863-9d50-0b7729327a1c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:28.173188 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b6531291-d145-4863-9d50-0b7729327a1c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:28.303006 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-b6531291-d145-4863-9d50-0b7729327a1c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:28.311037 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-b6531291-d145-4863-9d50-0b7729327a1c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c" status: 200 len: 1507 microversion: 2.1 time: 0.151298 Aug 03 05:18:28.311603 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 378/719] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:28 2022] GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:18:29.332586 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-38fb876b-a3a8-4da5-afe4-5a7403654495 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:29.333239 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-38fb876b-a3a8-4da5-afe4-5a7403654495 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:29.340653 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-38fb876b-a3a8-4da5-afe4-5a7403654495 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:29.341098 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-38fb876b-a3a8-4da5-afe4-5a7403654495 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:29.341856 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-38fb876b-a3a8-4da5-afe4-5a7403654495 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:29.342290 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-38fb876b-a3a8-4da5-afe4-5a7403654495 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:29.473197 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-38fb876b-a3a8-4da5-afe4-5a7403654495 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:29.480725 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-38fb876b-a3a8-4da5-afe4-5a7403654495 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c" status: 200 len: 1507 microversion: 2.1 time: 0.151974 Aug 03 05:18:29.481265 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 342/720] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:29 2022] GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:18:30.500944 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-5d7ccdd7-3670-44b0-80a0-d5a9876a6572 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:30.501547 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-5d7ccdd7-3670-44b0-80a0-d5a9876a6572 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:30.508090 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5d7ccdd7-3670-44b0-80a0-d5a9876a6572 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:30.508539 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5d7ccdd7-3670-44b0-80a0-d5a9876a6572 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:30.509297 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5d7ccdd7-3670-44b0-80a0-d5a9876a6572 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:30.509728 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5d7ccdd7-3670-44b0-80a0-d5a9876a6572 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:30.642364 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-5d7ccdd7-3670-44b0-80a0-d5a9876a6572 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:30.651957 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-5d7ccdd7-3670-44b0-80a0-d5a9876a6572 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c" status: 200 len: 1507 microversion: 2.1 time: 0.154826 Aug 03 05:18:30.652542 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 379/721] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:30 2022] GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:18:31.674031 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-ed63443f-f8f7-400d-bbef-049187936bff tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:31.677525 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-ed63443f-f8f7-400d-bbef-049187936bff tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:31.681403 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-ed63443f-f8f7-400d-bbef-049187936bff tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:31.681857 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-ed63443f-f8f7-400d-bbef-049187936bff tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:31.682632 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-ed63443f-f8f7-400d-bbef-049187936bff tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:31.683152 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-ed63443f-f8f7-400d-bbef-049187936bff tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:31.820576 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-ed63443f-f8f7-400d-bbef-049187936bff tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:31.830307 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-ed63443f-f8f7-400d-bbef-049187936bff tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c" status: 200 len: 1507 microversion: 2.1 time: 0.160366 Aug 03 05:18:31.830924 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 343/722] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:31 2022] GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:18:32.120686 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-82bcdf4f-e5a1-42d4-8296-2916becc1a3e req-bd54e288-19b6-4b5d-9ae7-a02b720c1178 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50296975-4478-4122-a599-548a4cbb582c", "name": "network-vif-deleted", "tag": "a1951f3c-b093-496d-be25-7c755eb6f752"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:18:32.131338 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-82bcdf4f-e5a1-42d4-8296-2916becc1a3e req-bd54e288-19b6-4b5d-9ae7-a02b720c1178 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:32.131787 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-82bcdf4f-e5a1-42d4-8296-2916becc1a3e req-bd54e288-19b6-4b5d-9ae7-a02b720c1178 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:32.143534 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-82bcdf4f-e5a1-42d4-8296-2916becc1a3e req-bd54e288-19b6-4b5d-9ae7-a02b720c1178 service nova] Creating event network-vif-deleted:a1951f3c-b093-496d-be25-7c755eb6f752 for instance 50296975-4478-4122-a599-548a4cbb582c on hv-cinder-85127 Aug 03 05:18:32.148592 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-82bcdf4f-e5a1-42d4-8296-2916becc1a3e req-bd54e288-19b6-4b5d-9ae7-a02b720c1178 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031553 Aug 03 05:18:32.149195 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 380/723] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:18:32.851215 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-116ccbf5-9588-48bc-be4e-cf8b8746431b tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:32.851804 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-116ccbf5-9588-48bc-be4e-cf8b8746431b tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:32.859396 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-116ccbf5-9588-48bc-be4e-cf8b8746431b tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:32.860126 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-116ccbf5-9588-48bc-be4e-cf8b8746431b tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:32.860633 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-116ccbf5-9588-48bc-be4e-cf8b8746431b tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:32.861059 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-116ccbf5-9588-48bc-be4e-cf8b8746431b tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:32.892354 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-116ccbf5-9588-48bc-be4e-cf8b8746431b tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:32.892817 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-116ccbf5-9588-48bc-be4e-cf8b8746431b tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:32.893289 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.objects.instance [None req-116ccbf5-9588-48bc-be4e-cf8b8746431b tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lazy-loading 'fault' on Instance uuid 50296975-4478-4122-a599-548a4cbb582c {{(pid=118332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:18:32.937236 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-116ccbf5-9588-48bc-be4e-cf8b8746431b tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:32.945295 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-116ccbf5-9588-48bc-be4e-cf8b8746431b tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c" status: 200 len: 1312 microversion: 2.1 time: 0.097850 Aug 03 05:18:32.945875 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 344/724] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:32 2022] GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c => generated 1312 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:18:33.973244 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-0393e419-62b4-4e03-ab20-63ef5a9252ef tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:33.973853 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-0393e419-62b4-4e03-ab20-63ef5a9252ef tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 50296975-4478-4122-a599-548a4cbb582c] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:33.979998 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0393e419-62b4-4e03-ab20-63ef5a9252ef tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:33.980446 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0393e419-62b4-4e03-ab20-63ef5a9252ef tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:33.981207 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0393e419-62b4-4e03-ab20-63ef5a9252ef tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:33.981643 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0393e419-62b4-4e03-ab20-63ef5a9252ef tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:33.994549 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.wsgi [None req-0393e419-62b4-4e03-ab20-63ef5a9252ef tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] HTTP exception thrown: Instance 50296975-4478-4122-a599-548a4cbb582c could not be found. Aug 03 05:18:33.996239 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-0393e419-62b4-4e03-ab20-63ef5a9252ef tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Request method failure captured: Aug 03 05:18:33.996239 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: request: GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c HTTP/1.1 Aug 03 05:18:33.996239 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Accept: application/json Aug 03 05:18:33.996239 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Accept-Encoding: identity Aug 03 05:18:33.996239 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Connection: close Aug 03 05:18:33.996239 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Content-Length: 0 Aug 03 05:18:33.996239 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Content-Type: application/json Aug 03 05:18:33.996239 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Host: 10.222.0.40 Aug 03 05:18:33.996239 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Openstack-System-Scope: None Aug 03 05:18:33.996239 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: User-Agent: python-urllib3/1.26.10 Aug 03 05:18:33.996239 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Auth-Token: gAAAAABi6gPTVv1oE_O2DS7JexgjiVZZ5yTvwFfTDvv3fgwnZVMm1QuvOqQPlPZjdlHsUhwyK7cAnIGz147fLocUeEXFYRmV5CkqTfDI-9PO3MxodM9kCsKki6-i9zKuoaKrTaTYSrvfPqxK8YsU3BCLBF7PgTgJHbL8c6JahRaay9047vP40N4 Aug 03 05:18:33.996239 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Domain-Id: None Aug 03 05:18:33.996239 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Domain-Name: None Aug 03 05:18:33.996239 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Identity-Status: Confirmed Aug 03 05:18:33.996239 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Is-Admin-Project: True Aug 03 05:18:33.996239 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Domain-Id: default Aug 03 05:18:33.996239 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Domain-Name: Default Aug 03 05:18:33.996239 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Id: 829c8e80e96d40d682a17185eb4da336 Aug 03 05:18:33.996239 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1128427595 Aug 03 05:18:33.996239 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Role: member,reader Aug 03 05:18:33.996239 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Roles: member,reader Aug 03 05:18:33.997917 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_829c8e80e96d40d682a17185eb4da336"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/829c8e80e96d40d682a17185eb4da336"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/829c8e80e96d40d682a17185eb4da336"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/829c8e80e96d40d682a17185eb4da336"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:18:33.997917 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1128427595 Aug 03 05:18:33.997917 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant-Id: 829c8e80e96d40d682a17185eb4da336 Aug 03 05:18:33.997917 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1128427595 Aug 03 05:18:33.997917 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User: tempest-ServerRescueNegativeTestJSON-1128427595-project Aug 03 05:18:33.997917 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Domain-Id: default Aug 03 05:18:33.997917 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Domain-Name: Default Aug 03 05:18:33.997917 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Id: bb0fe4cb98e0447cad3e126da1a8de9c Aug 03 05:18:33.997917 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1128427595-project Aug 03 05:18:33.997917 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: method: > Aug 03 05:18:33.997917 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: exception: Instance 50296975-4478-4122-a599-548a4cbb582c could not be found. Aug 03 05:18:33.997917 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: action_args: {'id': '50296975-4478-4122-a599-548a4cbb582c'} Aug 03 05:18:33.999144 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:18:33.999144 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:18:33.999144 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:18:33.999144 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:18:33.999144 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:18:33.999144 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:18:33.999144 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:18:33.999144 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:18:33.999144 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:18:33.999144 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:18:33.999144 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50296975-4478-4122-a599-548a4cbb582c could not be found. Aug 03 05:18:33.999144 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:18:33.999144 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:18:33.999144 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:18:33.999144 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:18:33.999144 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:18:33.999144 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:18:33.999144 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:18:33.999144 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:18:33.999144 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:18:34.000612 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:18:34.000612 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:18:34.000612 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:18:34.000612 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:18:34.000612 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:18:34.000612 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:18:34.000612 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:18:34.000612 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50296975-4478-4122-a599-548a4cbb582c could not be found. Aug 03 05:18:34.000612 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:18:34.000612 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:18:34.000612 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:18:34.000612 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:18:34.000612 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:18:34.000612 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:18:34.000612 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:18:34.000612 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:18:34.000612 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50296975-4478-4122-a599-548a4cbb582c could not be found. Aug 03 05:18:34.000612 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:18:34.002514 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-0393e419-62b4-4e03-ab20-63ef5a9252ef tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Returning 404 to user: Instance 50296975-4478-4122-a599-548a4cbb582c could not be found. {{(pid=118331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:18:34.002514 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-0393e419-62b4-4e03-ab20-63ef5a9252ef tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c" status: 404 len: 111 microversion: 2.1 time: 0.029208 Aug 03 05:18:34.002514 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 381/725] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:33 2022] GET /compute/v2.1/servers/50296975-4478-4122-a599-548a4cbb582c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:18:34.006377 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-4c70c68a-b2bd-4706-8493-d8569bfbd8f3 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:34.009032 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-4c70c68a-b2bd-4706-8493-d8569bfbd8f3 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 7ee7115a-8a61-415c-a4ba-b53c2aa0c442] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:34.014358 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-4c70c68a-b2bd-4706-8493-d8569bfbd8f3 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:34.014815 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-4c70c68a-b2bd-4706-8493-d8569bfbd8f3 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:34.015732 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-4c70c68a-b2bd-4706-8493-d8569bfbd8f3 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:34.016098 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-4c70c68a-b2bd-4706-8493-d8569bfbd8f3 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:34.043461 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-4c70c68a-b2bd-4706-8493-d8569bfbd8f3 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 7ee7115a-8a61-415c-a4ba-b53c2aa0c442] Going to try to terminate instance {{(pid=118332) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:18:34.400979 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-4c70c68a-b2bd-4706-8493-d8569bfbd8f3 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442" status: 204 len: 0 microversion: 2.1 time: 0.398017 Aug 03 05:18:34.401825 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 345/726] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Aug 3 05:18:34 2022] DELETE /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:18:34.409695 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-821b8130-ed58-452f-a029-941a60e5fec2 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:34.410386 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-821b8130-ed58-452f-a029-941a60e5fec2 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 7ee7115a-8a61-415c-a4ba-b53c2aa0c442] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:34.417238 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-821b8130-ed58-452f-a029-941a60e5fec2 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:34.417697 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-821b8130-ed58-452f-a029-941a60e5fec2 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:34.418475 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-821b8130-ed58-452f-a029-941a60e5fec2 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:34.418947 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-821b8130-ed58-452f-a029-941a60e5fec2 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:34.549883 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-821b8130-ed58-452f-a029-941a60e5fec2 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:34.557665 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-821b8130-ed58-452f-a029-941a60e5fec2 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442" status: 200 len: 1521 microversion: 2.1 time: 0.151802 Aug 03 05:18:34.558232 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 382/727] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:34 2022] GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:18:35.579982 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-ab4233c4-02a3-4371-9173-d8ff2a6cfbf7 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:35.580615 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-ab4233c4-02a3-4371-9173-d8ff2a6cfbf7 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 7ee7115a-8a61-415c-a4ba-b53c2aa0c442] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:35.587155 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-ab4233c4-02a3-4371-9173-d8ff2a6cfbf7 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:35.587610 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-ab4233c4-02a3-4371-9173-d8ff2a6cfbf7 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:35.588379 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-ab4233c4-02a3-4371-9173-d8ff2a6cfbf7 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:35.588822 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-ab4233c4-02a3-4371-9173-d8ff2a6cfbf7 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:35.722390 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-ab4233c4-02a3-4371-9173-d8ff2a6cfbf7 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:35.729877 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-ab4233c4-02a3-4371-9173-d8ff2a6cfbf7 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442" status: 200 len: 1521 microversion: 2.1 time: 0.154123 Aug 03 05:18:35.730443 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 346/728] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:35 2022] GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:18:36.752081 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-087fd8b2-e49c-4157-aef2-6648671d0def tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:36.752697 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-087fd8b2-e49c-4157-aef2-6648671d0def tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 7ee7115a-8a61-415c-a4ba-b53c2aa0c442] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:36.759326 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-087fd8b2-e49c-4157-aef2-6648671d0def tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:36.759783 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-087fd8b2-e49c-4157-aef2-6648671d0def tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:36.760551 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-087fd8b2-e49c-4157-aef2-6648671d0def tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:36.760994 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-087fd8b2-e49c-4157-aef2-6648671d0def tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:36.890311 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-087fd8b2-e49c-4157-aef2-6648671d0def tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:36.897611 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-087fd8b2-e49c-4157-aef2-6648671d0def tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442" status: 200 len: 1521 microversion: 2.1 time: 0.149415 Aug 03 05:18:36.898173 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 383/729] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:36 2022] GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:18:37.917757 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-1c94a9a6-dc1e-4c36-b148-20a7fd55712a tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:37.918825 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-1c94a9a6-dc1e-4c36-b148-20a7fd55712a tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 7ee7115a-8a61-415c-a4ba-b53c2aa0c442] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:37.925340 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-1c94a9a6-dc1e-4c36-b148-20a7fd55712a tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:37.925792 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-1c94a9a6-dc1e-4c36-b148-20a7fd55712a tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:37.926556 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-1c94a9a6-dc1e-4c36-b148-20a7fd55712a tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:37.927027 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-1c94a9a6-dc1e-4c36-b148-20a7fd55712a tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:38.066471 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-1c94a9a6-dc1e-4c36-b148-20a7fd55712a tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:38.073936 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-1c94a9a6-dc1e-4c36-b148-20a7fd55712a tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442" status: 200 len: 1521 microversion: 2.1 time: 0.160325 Aug 03 05:18:38.075183 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 347/730] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:37 2022] GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:18:39.096323 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-317d01dd-2d2d-49d9-ade9-16ba4c5cc02a tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:39.096983 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-317d01dd-2d2d-49d9-ade9-16ba4c5cc02a tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 7ee7115a-8a61-415c-a4ba-b53c2aa0c442] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:39.103566 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-317d01dd-2d2d-49d9-ade9-16ba4c5cc02a tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:39.104019 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-317d01dd-2d2d-49d9-ade9-16ba4c5cc02a tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:39.104777 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-317d01dd-2d2d-49d9-ade9-16ba4c5cc02a tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:39.105219 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-317d01dd-2d2d-49d9-ade9-16ba4c5cc02a tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:39.237017 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-317d01dd-2d2d-49d9-ade9-16ba4c5cc02a tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:39.240580 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:18:39.251029 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-317d01dd-2d2d-49d9-ade9-16ba4c5cc02a tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442" status: 200 len: 1521 microversion: 2.1 time: 0.157276 Aug 03 05:18:39.251029 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 384/731] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:39 2022] GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:18:40.126478 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [req-550e9fe8-7ca7-4223-8a52-8d082b4e022d req-2fd05a2f-df4e-4776-a638-246f485cae8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ee7115a-8a61-415c-a4ba-b53c2aa0c442", "name": "network-vif-deleted", "tag": "945d4b78-7ce8-433a-86ca-fd52994ea333"}]} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:18:40.136646 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-550e9fe8-7ca7-4223-8a52-8d082b4e022d req-2fd05a2f-df4e-4776-a638-246f485cae8d service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:40.137021 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-550e9fe8-7ca7-4223-8a52-8d082b4e022d req-2fd05a2f-df4e-4776-a638-246f485cae8d service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:40.147984 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.compute.server_external_events [req-550e9fe8-7ca7-4223-8a52-8d082b4e022d req-2fd05a2f-df4e-4776-a638-246f485cae8d service nova] Creating event network-vif-deleted:945d4b78-7ce8-433a-86ca-fd52994ea333 for instance 7ee7115a-8a61-415c-a4ba-b53c2aa0c442 on hv-cinder-85127 Aug 03 05:18:40.152965 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [req-550e9fe8-7ca7-4223-8a52-8d082b4e022d req-2fd05a2f-df4e-4776-a638-246f485cae8d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030309 Aug 03 05:18:40.153550 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 348/732] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:18:40.271765 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-a809a9cb-d317-4b21-a4a8-cfd7a599103c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:40.272372 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-a809a9cb-d317-4b21-a4a8-cfd7a599103c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 7ee7115a-8a61-415c-a4ba-b53c2aa0c442] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:40.279899 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a809a9cb-d317-4b21-a4a8-cfd7a599103c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:40.280357 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a809a9cb-d317-4b21-a4a8-cfd7a599103c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:40.281143 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a809a9cb-d317-4b21-a4a8-cfd7a599103c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:40.281590 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a809a9cb-d317-4b21-a4a8-cfd7a599103c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:40.344718 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-a809a9cb-d317-4b21-a4a8-cfd7a599103c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0fe4cb98e0447cad3e126da1a8de9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829c8e80e96d40d682a17185eb4da336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:40.352107 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-a809a9cb-d317-4b21-a4a8-cfd7a599103c tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442" status: 200 len: 1307 microversion: 2.1 time: 0.084525 Aug 03 05:18:40.352680 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 385/733] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:40 2022] GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442 => generated 1307 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:18:41.375162 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-e64cd849-162d-471c-9161-6688e825d3c1 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:41.375893 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-e64cd849-162d-471c-9161-6688e825d3c1 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] [instance: 7ee7115a-8a61-415c-a4ba-b53c2aa0c442] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:41.382098 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e64cd849-162d-471c-9161-6688e825d3c1 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:41.382560 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e64cd849-162d-471c-9161-6688e825d3c1 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:41.383350 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e64cd849-162d-471c-9161-6688e825d3c1 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:41.383796 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e64cd849-162d-471c-9161-6688e825d3c1 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:41.397330 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.wsgi [None req-e64cd849-162d-471c-9161-6688e825d3c1 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] HTTP exception thrown: Instance 7ee7115a-8a61-415c-a4ba-b53c2aa0c442 could not be found. Aug 03 05:18:41.398994 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-e64cd849-162d-471c-9161-6688e825d3c1 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Request method failure captured: Aug 03 05:18:41.398994 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: request: GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442 HTTP/1.1 Aug 03 05:18:41.398994 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Accept: application/json Aug 03 05:18:41.398994 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Accept-Encoding: identity Aug 03 05:18:41.398994 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Connection: close Aug 03 05:18:41.398994 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Content-Length: 0 Aug 03 05:18:41.398994 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Content-Type: application/json Aug 03 05:18:41.398994 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Host: 10.222.0.40 Aug 03 05:18:41.398994 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Openstack-System-Scope: None Aug 03 05:18:41.398994 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: User-Agent: python-urllib3/1.26.10 Aug 03 05:18:41.398994 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Auth-Token: gAAAAABi6gPTVv1oE_O2DS7JexgjiVZZ5yTvwFfTDvv3fgwnZVMm1QuvOqQPlPZjdlHsUhwyK7cAnIGz147fLocUeEXFYRmV5CkqTfDI-9PO3MxodM9kCsKki6-i9zKuoaKrTaTYSrvfPqxK8YsU3BCLBF7PgTgJHbL8c6JahRaay9047vP40N4 Aug 03 05:18:41.398994 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Domain-Id: None Aug 03 05:18:41.398994 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Domain-Name: None Aug 03 05:18:41.398994 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Identity-Status: Confirmed Aug 03 05:18:41.398994 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Is-Admin-Project: True Aug 03 05:18:41.398994 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Domain-Id: default Aug 03 05:18:41.398994 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Domain-Name: Default Aug 03 05:18:41.398994 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Id: 829c8e80e96d40d682a17185eb4da336 Aug 03 05:18:41.398994 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1128427595 Aug 03 05:18:41.398994 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Role: member,reader Aug 03 05:18:41.398994 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Roles: member,reader Aug 03 05:18:41.400538 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_829c8e80e96d40d682a17185eb4da336"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/829c8e80e96d40d682a17185eb4da336"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/829c8e80e96d40d682a17185eb4da336"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/829c8e80e96d40d682a17185eb4da336"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:18:41.400538 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1128427595 Aug 03 05:18:41.400538 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant-Id: 829c8e80e96d40d682a17185eb4da336 Aug 03 05:18:41.400538 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1128427595 Aug 03 05:18:41.400538 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User: tempest-ServerRescueNegativeTestJSON-1128427595-project Aug 03 05:18:41.400538 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Domain-Id: default Aug 03 05:18:41.400538 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Domain-Name: Default Aug 03 05:18:41.400538 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Id: bb0fe4cb98e0447cad3e126da1a8de9c Aug 03 05:18:41.400538 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1128427595-project Aug 03 05:18:41.400538 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: method: > Aug 03 05:18:41.400538 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: exception: Instance 7ee7115a-8a61-415c-a4ba-b53c2aa0c442 could not be found. Aug 03 05:18:41.400538 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: action_args: {'id': '7ee7115a-8a61-415c-a4ba-b53c2aa0c442'} Aug 03 05:18:41.401527 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:18:41.401527 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:18:41.401527 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:18:41.401527 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:18:41.401527 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:18:41.401527 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:18:41.401527 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:18:41.401527 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:18:41.401527 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:18:41.401527 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:18:41.401527 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ee7115a-8a61-415c-a4ba-b53c2aa0c442 could not be found. Aug 03 05:18:41.401527 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:18:41.401527 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:18:41.401527 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:18:41.401527 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:18:41.401527 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:18:41.401527 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:18:41.401527 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:18:41.401527 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:18:41.401527 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:18:41.402754 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:18:41.402754 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:18:41.402754 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:18:41.402754 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:18:41.402754 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:18:41.402754 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:18:41.402754 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:18:41.402754 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ee7115a-8a61-415c-a4ba-b53c2aa0c442 could not be found. Aug 03 05:18:41.402754 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:18:41.402754 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:18:41.402754 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:18:41.402754 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:18:41.402754 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:18:41.402754 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:18:41.402754 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:18:41.402754 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:18:41.402754 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ee7115a-8a61-415c-a4ba-b53c2aa0c442 could not be found. Aug 03 05:18:41.402754 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:18:41.404008 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-e64cd849-162d-471c-9161-6688e825d3c1 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] Returning 404 to user: Instance 7ee7115a-8a61-415c-a4ba-b53c2aa0c442 could not be found. {{(pid=118332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:18:41.404008 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-e64cd849-162d-471c-9161-6688e825d3c1 tempest-ServerRescueNegativeTestJSON-1128427595 tempest-ServerRescueNegativeTestJSON-1128427595-project] 10.222.0.40 "GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442" status: 404 len: 111 microversion: 2.1 time: 0.030556 Aug 03 05:18:41.404008 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 349/734] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:41 2022] GET /compute/v2.1/servers/7ee7115a-8a61-415c-a4ba-b53c2aa0c442 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:18:45.913074 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-0c3def15-95af-4510-89f9-886615379217 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-234787560"}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:18:45.913710 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-0c3def15-95af-4510-89f9-886615379217 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] [instance: 363118dd-a0c3-444f-99cb-f0578407e0d2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:45.922214 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0c3def15-95af-4510-89f9-886615379217 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:45.922745 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0c3def15-95af-4510-89f9-886615379217 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:45.925420 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0c3def15-95af-4510-89f9-886615379217 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:45.925420 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0c3def15-95af-4510-89f9-886615379217 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:46.062927 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.network.security_group_api [None req-0c3def15-95af-4510-89f9-886615379217 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Removing security group 907b5252-778d-4eaf-8628-54cb95c9fffb from port 1d2d095e-7779-4335-a8cf-cbd4d15b643b Aug 03 05:18:46.438132 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-0c3def15-95af-4510-89f9-886615379217 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "POST /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2/action" status: 202 len: 0 microversion: 2.1 time: 0.529720 Aug 03 05:18:46.438753 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 386/735] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Aug 3 05:18:45 2022] POST /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2/action => generated 0 bytes in 532 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:18:46.668330 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [req-4ad60f9d-8e2d-45ac-8cad-d0f29674519c req-ef8090b2-9c0b-48fa-8dfa-569dca800a76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "363118dd-a0c3-444f-99cb-f0578407e0d2", "tag": "1d2d095e-7779-4335-a8cf-cbd4d15b643b"}]} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:18:46.679342 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-4ad60f9d-8e2d-45ac-8cad-d0f29674519c req-ef8090b2-9c0b-48fa-8dfa-569dca800a76 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:46.680089 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-4ad60f9d-8e2d-45ac-8cad-d0f29674519c req-ef8090b2-9c0b-48fa-8dfa-569dca800a76 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:46.693259 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.compute.server_external_events [req-4ad60f9d-8e2d-45ac-8cad-d0f29674519c req-ef8090b2-9c0b-48fa-8dfa-569dca800a76 service nova] Creating event network-changed:1d2d095e-7779-4335-a8cf-cbd4d15b643b for instance 363118dd-a0c3-444f-99cb-f0578407e0d2 on hv-cinder-85127 Aug 03 05:18:46.700191 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [req-4ad60f9d-8e2d-45ac-8cad-d0f29674519c req-ef8090b2-9c0b-48fa-8dfa-569dca800a76 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.257663 Aug 03 05:18:46.700791 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 350/736] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:18:48.133760 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-a23cc5ec-107c-43e6-8e1a-d42ddb953f39 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:48.135129 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-a23cc5ec-107c-43e6-8e1a-d42ddb953f39 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] [instance: 363118dd-a0c3-444f-99cb-f0578407e0d2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:48.143453 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a23cc5ec-107c-43e6-8e1a-d42ddb953f39 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:48.143953 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a23cc5ec-107c-43e6-8e1a-d42ddb953f39 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:48.144871 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a23cc5ec-107c-43e6-8e1a-d42ddb953f39 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:48.145481 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a23cc5ec-107c-43e6-8e1a-d42ddb953f39 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:48.278080 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.objects.instance [None req-a23cc5ec-107c-43e6-8e1a-d42ddb953f39 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lazy-loading 'services' on Instance uuid 363118dd-a0c3-444f-99cb-f0578407e0d2 {{(pid=118331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:18:48.529977 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-a23cc5ec-107c-43e6-8e1a-d42ddb953f39 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "DELETE /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2/os-volume_attachments/a1fea637-e428-48f1-9106-333755de0420" status: 202 len: 0 microversion: 2.1 time: 0.400644 Aug 03 05:18:48.530968 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 387/737] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Aug 3 05:18:48 2022] DELETE /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2/os-volume_attachments/a1fea637-e428-48f1-9106-333755de0420 => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:18:48.540232 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-fdcae409-1aea-48f9-ad84-ece25827cf23 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:48.543895 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-fdcae409-1aea-48f9-ad84-ece25827cf23 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] [instance: 363118dd-a0c3-444f-99cb-f0578407e0d2] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:48.551028 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-fdcae409-1aea-48f9-ad84-ece25827cf23 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:48.551867 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-fdcae409-1aea-48f9-ad84-ece25827cf23 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:48.552811 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-fdcae409-1aea-48f9-ad84-ece25827cf23 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:48.553453 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-fdcae409-1aea-48f9-ad84-ece25827cf23 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:48.583421 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-fdcae409-1aea-48f9-ad84-ece25827cf23 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047936 Aug 03 05:18:48.584446 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 351/738] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Aug 3 05:18:48 2022] GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:18:48.719363 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-1b63a561-6137-45ea-984b-ee06fb5acaa4 req-8aa4a929-f14d-4854-9df6-9f0b801c5b63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "363118dd-a0c3-444f-99cb-f0578407e0d2", "tag": "1d2d095e-7779-4335-a8cf-cbd4d15b643b"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:18:48.729420 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-1b63a561-6137-45ea-984b-ee06fb5acaa4 req-8aa4a929-f14d-4854-9df6-9f0b801c5b63 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:48.731680 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-1b63a561-6137-45ea-984b-ee06fb5acaa4 req-8aa4a929-f14d-4854-9df6-9f0b801c5b63 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:48.743739 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-1b63a561-6137-45ea-984b-ee06fb5acaa4 req-8aa4a929-f14d-4854-9df6-9f0b801c5b63 service nova] Creating event network-changed:1d2d095e-7779-4335-a8cf-cbd4d15b643b for instance 363118dd-a0c3-444f-99cb-f0578407e0d2 on hv-cinder-85127 Aug 03 05:18:48.749099 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-1b63a561-6137-45ea-984b-ee06fb5acaa4 req-8aa4a929-f14d-4854-9df6-9f0b801c5b63 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034722 Aug 03 05:18:48.762816 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 388/739] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:18:49.596384 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-a152bc34-f087-4c9c-a707-3c0fe00c2fae tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:49.598548 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-a152bc34-f087-4c9c-a707-3c0fe00c2fae tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] [instance: 363118dd-a0c3-444f-99cb-f0578407e0d2] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:49.605033 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-a152bc34-f087-4c9c-a707-3c0fe00c2fae tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:49.605478 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-a152bc34-f087-4c9c-a707-3c0fe00c2fae tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:49.606245 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-a152bc34-f087-4c9c-a707-3c0fe00c2fae tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:49.606679 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-a152bc34-f087-4c9c-a707-3c0fe00c2fae tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:49.636717 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-a152bc34-f087-4c9c-a707-3c0fe00c2fae tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043637 Aug 03 05:18:49.637277 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 352/740] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Aug 3 05:18:49 2022] GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 05:18:49.648853 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-b4402c8c-aacc-4be0-93e7-d49d2f893d95 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:49.649446 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-b4402c8c-aacc-4be0-93e7-d49d2f893d95 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] [instance: 363118dd-a0c3-444f-99cb-f0578407e0d2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:49.655855 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b4402c8c-aacc-4be0-93e7-d49d2f893d95 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:49.656304 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b4402c8c-aacc-4be0-93e7-d49d2f893d95 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:49.657111 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b4402c8c-aacc-4be0-93e7-d49d2f893d95 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:49.657523 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b4402c8c-aacc-4be0-93e7-d49d2f893d95 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:49.732157 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.wsgi [None req-b4402c8c-aacc-4be0-93e7-d49d2f893d95 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] HTTP exception thrown: Instance 363118dd-a0c3-444f-99cb-f0578407e0d2 is not attached to volume a1fea637-e428-48f1-9106-333755de0420 Aug 03 05:18:49.741842 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-b4402c8c-aacc-4be0-93e7-d49d2f893d95 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Request method failure captured: Aug 03 05:18:49.741842 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: request: DELETE /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2/os-volume_attachments/a1fea637-e428-48f1-9106-333755de0420 HTTP/1.1 Aug 03 05:18:49.741842 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Accept: application/json Aug 03 05:18:49.741842 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Accept-Encoding: identity Aug 03 05:18:49.741842 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Connection: close Aug 03 05:18:49.741842 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Content-Length: 0 Aug 03 05:18:49.741842 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Content-Type: application/json Aug 03 05:18:49.741842 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Host: 10.222.0.40 Aug 03 05:18:49.741842 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Openstack-System-Scope: None Aug 03 05:18:49.741842 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: User-Agent: python-urllib3/1.26.10 Aug 03 05:18:49.741842 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Auth-Token: gAAAAABi6gRf7vMEqWhEQEaDY3AKBBSM3bodEr9zaGTp-IgCYSeWZWCS4PmqzDwc8nkkwyQYInA9yitRuXbBTHNIo7fNQi0zNKsKGYbPfL_z0UShnSPJpZM9aFZNrDjLp5paga_4T_GCWOeV48kvFGYoaOlGoNxpkh2pBgbsPDg_5W5TA90U-_I Aug 03 05:18:49.741842 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Domain-Id: None Aug 03 05:18:49.741842 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Domain-Name: None Aug 03 05:18:49.741842 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Identity-Status: Confirmed Aug 03 05:18:49.741842 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Is-Admin-Project: True Aug 03 05:18:49.741842 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Domain-Id: default Aug 03 05:18:49.741842 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Domain-Name: Default Aug 03 05:18:49.741842 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Id: 7d7bf6baa2224b0d910133c5542608e1 Aug 03 05:18:49.741842 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Name: tempest-TestMinimumBasicScenario-2063170409 Aug 03 05:18:49.741842 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Role: member,reader Aug 03 05:18:49.741842 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Roles: member,reader Aug 03 05:18:49.744167 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7d7bf6baa2224b0d910133c5542608e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7d7bf6baa2224b0d910133c5542608e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7d7bf6baa2224b0d910133c5542608e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7d7bf6baa2224b0d910133c5542608e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:18:49.744167 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant: tempest-TestMinimumBasicScenario-2063170409 Aug 03 05:18:49.744167 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant-Id: 7d7bf6baa2224b0d910133c5542608e1 Aug 03 05:18:49.744167 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2063170409 Aug 03 05:18:49.744167 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User: tempest-TestMinimumBasicScenario-2063170409-project Aug 03 05:18:49.744167 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Domain-Id: default Aug 03 05:18:49.744167 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Domain-Name: Default Aug 03 05:18:49.744167 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Id: 79539af2999d48baa11734ced32dccb2 Aug 03 05:18:49.744167 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Name: tempest-TestMinimumBasicScenario-2063170409-project Aug 03 05:18:49.744167 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: method: > Aug 03 05:18:49.744167 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: exception: Instance 363118dd-a0c3-444f-99cb-f0578407e0d2 is not attached to volume a1fea637-e428-48f1-9106-333755de0420 Aug 03 05:18:49.745078 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: action_args: {'server_id': '363118dd-a0c3-444f-99cb-f0578407e0d2', 'id': 'a1fea637-e428-48f1-9106-333755de0420'} Aug 03 05:18:49.745078 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:18:49.745078 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:18:49.745078 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 03 05:18:49.745078 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 03 05:18:49.745078 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 05:18:49.745078 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 05:18:49.745078 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 03 05:18:49.745078 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 03 05:18:49.745078 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a1fea637-e428-48f1-9106-333755de0420. Aug 03 05:18:49.745078 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:18:49.745078 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:18:49.745078 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:18:49.745078 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:18:49.745078 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:18:49.745078 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:18:49.745078 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:18:49.745078 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:18:49.745078 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:18:49.747153 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:18:49.747153 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 03 05:18:49.747153 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 03 05:18:49.747153 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 363118dd-a0c3-444f-99cb-f0578407e0d2 is not attached to volume a1fea637-e428-48f1-9106-333755de0420 Aug 03 05:18:49.747153 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:18:49.747153 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:18:49.747153 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:18:49.747153 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:18:49.747153 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:18:49.747153 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:18:49.747153 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:18:49.747153 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:18:49.747153 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 363118dd-a0c3-444f-99cb-f0578407e0d2 is not attached to volume a1fea637-e428-48f1-9106-333755de0420 Aug 03 05:18:49.747153 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:18:49.747153 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-b4402c8c-aacc-4be0-93e7-d49d2f893d95 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Returning 404 to user: Instance 363118dd-a0c3-444f-99cb-f0578407e0d2 is not attached to volume a1fea637-e428-48f1-9106-333755de0420 {{(pid=118331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:18:49.748392 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-b4402c8c-aacc-4be0-93e7-d49d2f893d95 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "DELETE /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2/os-volume_attachments/a1fea637-e428-48f1-9106-333755de0420" status: 404 len: 154 microversion: 2.1 time: 0.099236 Aug 03 05:18:49.748392 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 389/741] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Aug 3 05:18:49 2022] DELETE /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2/os-volume_attachments/a1fea637-e428-48f1-9106-333755de0420 => generated 154 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:18:51.001506 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-0151ebcc-44eb-43fb-a81b-8f035af7eb65 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:51.002067 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-0151ebcc-44eb-43fb-a81b-8f035af7eb65 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] [instance: 363118dd-a0c3-444f-99cb-f0578407e0d2] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:51.008520 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-0151ebcc-44eb-43fb-a81b-8f035af7eb65 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:51.008968 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-0151ebcc-44eb-43fb-a81b-8f035af7eb65 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:51.009722 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-0151ebcc-44eb-43fb-a81b-8f035af7eb65 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:51.010153 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-0151ebcc-44eb-43fb-a81b-8f035af7eb65 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:51.014526 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:18:51.036931 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-0151ebcc-44eb-43fb-a81b-8f035af7eb65 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] [instance: 363118dd-a0c3-444f-99cb-f0578407e0d2] Going to try to terminate instance {{(pid=118332) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:18:51.341941 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-0151ebcc-44eb-43fb-a81b-8f035af7eb65 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "DELETE /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2" status: 204 len: 0 microversion: 2.1 time: 0.343907 Aug 03 05:18:51.342900 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 353/742] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Aug 3 05:18:50 2022] DELETE /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:18:51.350933 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-9aa98550-e741-40f6-a08f-f552855352ce tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:51.351607 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-9aa98550-e741-40f6-a08f-f552855352ce tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] [instance: 363118dd-a0c3-444f-99cb-f0578407e0d2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:51.358555 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9aa98550-e741-40f6-a08f-f552855352ce tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:51.359045 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9aa98550-e741-40f6-a08f-f552855352ce tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:51.360049 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9aa98550-e741-40f6-a08f-f552855352ce tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:51.360488 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9aa98550-e741-40f6-a08f-f552855352ce tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:51.498051 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-9aa98550-e741-40f6-a08f-f552855352ce tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79539af2999d48baa11734ced32dccb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d7bf6baa2224b0d910133c5542608e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:51.506346 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-9aa98550-e741-40f6-a08f-f552855352ce tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2" status: 200 len: 1555 microversion: 2.1 time: 0.159294 Aug 03 05:18:51.507011 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 390/743] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:51 2022] GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2 => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:18:52.528961 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-59902f39-5708-4349-987c-364cf368e214 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:52.529655 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-59902f39-5708-4349-987c-364cf368e214 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] [instance: 363118dd-a0c3-444f-99cb-f0578407e0d2] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:52.536455 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-59902f39-5708-4349-987c-364cf368e214 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:52.536885 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-59902f39-5708-4349-987c-364cf368e214 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:52.537746 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-59902f39-5708-4349-987c-364cf368e214 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:52.538188 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-59902f39-5708-4349-987c-364cf368e214 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:52.675286 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-59902f39-5708-4349-987c-364cf368e214 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79539af2999d48baa11734ced32dccb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d7bf6baa2224b0d910133c5542608e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:52.683446 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-59902f39-5708-4349-987c-364cf368e214 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2" status: 200 len: 1555 microversion: 2.1 time: 0.158082 Aug 03 05:18:52.684030 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 354/744] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:52 2022] GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2 => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:18:53.705100 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-a8909e5a-01d1-4cad-bc8b-8affcb1a4af4 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:53.706327 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-a8909e5a-01d1-4cad-bc8b-8affcb1a4af4 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] [instance: 363118dd-a0c3-444f-99cb-f0578407e0d2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:53.714542 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a8909e5a-01d1-4cad-bc8b-8affcb1a4af4 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:53.715420 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a8909e5a-01d1-4cad-bc8b-8affcb1a4af4 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:53.716408 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a8909e5a-01d1-4cad-bc8b-8affcb1a4af4 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:53.717012 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a8909e5a-01d1-4cad-bc8b-8affcb1a4af4 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:53.829469 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [req-601caf61-2a4e-415f-9244-402a6de1bec1 req-50ead7b9-8485-4ca8-b379-318b346c9827 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "363118dd-a0c3-444f-99cb-f0578407e0d2", "name": "network-vif-deleted", "tag": "1d2d095e-7779-4335-a8cf-cbd4d15b643b"}]} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:18:53.840383 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-601caf61-2a4e-415f-9244-402a6de1bec1 req-50ead7b9-8485-4ca8-b379-318b346c9827 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:53.840852 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-601caf61-2a4e-415f-9244-402a6de1bec1 req-50ead7b9-8485-4ca8-b379-318b346c9827 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:53.847737 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-a8909e5a-01d1-4cad-bc8b-8affcb1a4af4 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79539af2999d48baa11734ced32dccb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d7bf6baa2224b0d910133c5542608e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:53.852290 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.compute.server_external_events [req-601caf61-2a4e-415f-9244-402a6de1bec1 req-50ead7b9-8485-4ca8-b379-318b346c9827 service nova] Creating event network-vif-deleted:1d2d095e-7779-4335-a8cf-cbd4d15b643b for instance 363118dd-a0c3-444f-99cb-f0578407e0d2 on hv-cinder-85127 Aug 03 05:18:53.855805 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-a8909e5a-01d1-4cad-bc8b-8affcb1a4af4 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2" status: 200 len: 1513 microversion: 2.1 time: 0.154816 Aug 03 05:18:53.861213 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 391/745] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:53 2022] GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:18:53.861674 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [req-601caf61-2a4e-415f-9244-402a6de1bec1 req-50ead7b9-8485-4ca8-b379-318b346c9827 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031935 Aug 03 05:18:53.861674 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 355/746] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:18:54.877216 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-1b3c2fd1-3fa9-42cd-9195-b2d316423af8 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:54.877907 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-1b3c2fd1-3fa9-42cd-9195-b2d316423af8 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] [instance: 363118dd-a0c3-444f-99cb-f0578407e0d2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:54.884379 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1b3c2fd1-3fa9-42cd-9195-b2d316423af8 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:54.884934 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1b3c2fd1-3fa9-42cd-9195-b2d316423af8 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:54.885764 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1b3c2fd1-3fa9-42cd-9195-b2d316423af8 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:54.886729 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1b3c2fd1-3fa9-42cd-9195-b2d316423af8 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:54.918975 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1b3c2fd1-3fa9-42cd-9195-b2d316423af8 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:54.919325 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1b3c2fd1-3fa9-42cd-9195-b2d316423af8 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:54.919873 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.objects.instance [None req-1b3c2fd1-3fa9-42cd-9195-b2d316423af8 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lazy-loading 'fault' on Instance uuid 363118dd-a0c3-444f-99cb-f0578407e0d2 {{(pid=118331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:18:54.967087 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-1b3c2fd1-3fa9-42cd-9195-b2d316423af8 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79539af2999d48baa11734ced32dccb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d7bf6baa2224b0d910133c5542608e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:54.974537 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-1b3c2fd1-3fa9-42cd-9195-b2d316423af8 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2" status: 200 len: 1348 microversion: 2.1 time: 0.101158 Aug 03 05:18:54.975145 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 392/747] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:54 2022] GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2 => generated 1348 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:18:55.997691 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-1a938bce-1243-4a2e-97f4-153e31f8ecf0 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:55.998531 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-1a938bce-1243-4a2e-97f4-153e31f8ecf0 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] [instance: 363118dd-a0c3-444f-99cb-f0578407e0d2] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:56.004798 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-1a938bce-1243-4a2e-97f4-153e31f8ecf0 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:56.005256 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-1a938bce-1243-4a2e-97f4-153e31f8ecf0 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:56.006029 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-1a938bce-1243-4a2e-97f4-153e31f8ecf0 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:56.006474 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-1a938bce-1243-4a2e-97f4-153e31f8ecf0 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:56.020650 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.wsgi [None req-1a938bce-1243-4a2e-97f4-153e31f8ecf0 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] HTTP exception thrown: Instance 363118dd-a0c3-444f-99cb-f0578407e0d2 could not be found. Aug 03 05:18:56.022292 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-1a938bce-1243-4a2e-97f4-153e31f8ecf0 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Request method failure captured: Aug 03 05:18:56.022292 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: request: GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2 HTTP/1.1 Aug 03 05:18:56.022292 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Accept: application/json Aug 03 05:18:56.022292 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Accept-Encoding: identity Aug 03 05:18:56.022292 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Connection: close Aug 03 05:18:56.022292 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Content-Length: 0 Aug 03 05:18:56.022292 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Content-Type: application/json Aug 03 05:18:56.022292 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Host: 10.222.0.40 Aug 03 05:18:56.022292 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Openstack-System-Scope: None Aug 03 05:18:56.022292 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: User-Agent: python-urllib3/1.26.10 Aug 03 05:18:56.022292 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Auth-Token: gAAAAABi6gRf7vMEqWhEQEaDY3AKBBSM3bodEr9zaGTp-IgCYSeWZWCS4PmqzDwc8nkkwyQYInA9yitRuXbBTHNIo7fNQi0zNKsKGYbPfL_z0UShnSPJpZM9aFZNrDjLp5paga_4T_GCWOeV48kvFGYoaOlGoNxpkh2pBgbsPDg_5W5TA90U-_I Aug 03 05:18:56.022292 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Domain-Id: None Aug 03 05:18:56.022292 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Domain-Name: None Aug 03 05:18:56.022292 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Identity-Status: Confirmed Aug 03 05:18:56.022292 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Is-Admin-Project: True Aug 03 05:18:56.022292 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Domain-Id: default Aug 03 05:18:56.022292 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Domain-Name: Default Aug 03 05:18:56.022292 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Id: 7d7bf6baa2224b0d910133c5542608e1 Aug 03 05:18:56.022292 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Name: tempest-TestMinimumBasicScenario-2063170409 Aug 03 05:18:56.022292 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Role: member,reader Aug 03 05:18:56.022292 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Roles: member,reader Aug 03 05:18:56.023960 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7d7bf6baa2224b0d910133c5542608e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7d7bf6baa2224b0d910133c5542608e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7d7bf6baa2224b0d910133c5542608e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7d7bf6baa2224b0d910133c5542608e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:18:56.023960 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant: tempest-TestMinimumBasicScenario-2063170409 Aug 03 05:18:56.023960 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant-Id: 7d7bf6baa2224b0d910133c5542608e1 Aug 03 05:18:56.023960 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2063170409 Aug 03 05:18:56.023960 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User: tempest-TestMinimumBasicScenario-2063170409-project Aug 03 05:18:56.023960 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Domain-Id: default Aug 03 05:18:56.023960 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Domain-Name: Default Aug 03 05:18:56.023960 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Id: 79539af2999d48baa11734ced32dccb2 Aug 03 05:18:56.023960 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Name: tempest-TestMinimumBasicScenario-2063170409-project Aug 03 05:18:56.023960 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: method: > Aug 03 05:18:56.023960 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: exception: Instance 363118dd-a0c3-444f-99cb-f0578407e0d2 could not be found. Aug 03 05:18:56.023960 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: action_args: {'id': '363118dd-a0c3-444f-99cb-f0578407e0d2'} Aug 03 05:18:56.024712 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:18:56.024712 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:18:56.024712 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:18:56.024712 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:18:56.024712 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:18:56.024712 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:18:56.024712 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:18:56.024712 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:18:56.024712 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:18:56.024712 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:18:56.024712 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 363118dd-a0c3-444f-99cb-f0578407e0d2 could not be found. Aug 03 05:18:56.024712 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:18:56.024712 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:18:56.024712 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:18:56.024712 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:18:56.024712 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:18:56.024712 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:18:56.024712 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:18:56.024712 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:18:56.024712 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:18:56.027104 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:18:56.027104 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:18:56.027104 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:18:56.027104 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:18:56.027104 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:18:56.027104 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:18:56.027104 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:18:56.027104 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 363118dd-a0c3-444f-99cb-f0578407e0d2 could not be found. Aug 03 05:18:56.027104 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:18:56.027104 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:18:56.027104 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:18:56.027104 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:18:56.027104 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:18:56.027104 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:18:56.027104 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:18:56.027104 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:18:56.027104 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 363118dd-a0c3-444f-99cb-f0578407e0d2 could not be found. Aug 03 05:18:56.027104 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:18:56.028590 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-1a938bce-1243-4a2e-97f4-153e31f8ecf0 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Returning 404 to user: Instance 363118dd-a0c3-444f-99cb-f0578407e0d2 could not be found. {{(pid=118332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:18:56.028590 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-1a938bce-1243-4a2e-97f4-153e31f8ecf0 tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2" status: 404 len: 111 microversion: 2.1 time: 0.030705 Aug 03 05:18:56.028590 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 356/748] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:55 2022] GET /compute/v2.1/servers/363118dd-a0c3-444f-99cb-f0578407e0d2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:18:56.033222 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-80b87987-cc34-4e70-974a-cd91361adf1b tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] Calling method '.version_select at 0x7f7601df14c0>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:56.126930 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-80b87987-cc34-4e70-974a-cd91361adf1b tempest-TestMinimumBasicScenario-2063170409 tempest-TestMinimumBasicScenario-2063170409-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-412529992" status: 202 len: 0 microversion: 2.1 time: 0.097396 Aug 03 05:18:56.127517 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 393/749] 10.222.0.40 () {58 vars in 1269 bytes} [Wed Aug 3 05:18:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-412529992 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:18:58.260386 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-63aa8c7e-e191-442b-9472-2495b7e15ea2 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:58.268081 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-63aa8c7e-e191-442b-9472-2495b7e15ea2 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:58.268081 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=2 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:18:58.269633 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-63aa8c7e-e191-442b-9472-2495b7e15ea2 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:58.270320 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-63aa8c7e-e191-442b-9472-2495b7e15ea2 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:58.271302 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-63aa8c7e-e191-442b-9472-2495b7e15ea2 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:58.271741 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-63aa8c7e-e191-442b-9472-2495b7e15ea2 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:58.295645 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-63aa8c7e-e191-442b-9472-2495b7e15ea2 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700/ips" status: 200 len: 150 microversion: 2.20 time: 0.039103 Aug 03 05:18:58.296232 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 357/750] 10.222.0.40 () {60 vars in 1289 bytes} [Wed Aug 3 05:18:58 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 05:19:00.542663 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-4303f30a-500b-4d3f-986b-86ef894637e4 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:19:00.543991 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-4303f30a-500b-4d3f-986b-86ef894637e4 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:00.548344 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:19:00.557079 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4303f30a-500b-4d3f-986b-86ef894637e4 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:00.557755 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4303f30a-500b-4d3f-986b-86ef894637e4 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:00.559549 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4303f30a-500b-4d3f-986b-86ef894637e4 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:00.560152 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4303f30a-500b-4d3f-986b-86ef894637e4 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:00.591410 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.objects.instance [None req-4303f30a-500b-4d3f-986b-86ef894637e4 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lazy-loading 'flavor' on Instance uuid 67b3164b-4fb1-4812-94b7-cc60b3040700 {{(pid=118331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:19:01.148255 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-4303f30a-500b-4d3f-986b-86ef894637e4 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "POST /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700/action" status: 202 len: 0 microversion: 2.20 time: 0.610886 Aug 03 05:19:01.148852 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 394/751] 10.222.0.40 () {62 vars in 1319 bytes} [Wed Aug 3 05:19:00 2022] POST /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700/action => generated 0 bytes in 612 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:19:01.157476 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-ff04f3a3-3bf0-45f8-9049-88130f8719f1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:01.158132 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-ff04f3a3-3bf0-45f8-9049-88130f8719f1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:01.164958 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-ff04f3a3-3bf0-45f8-9049-88130f8719f1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:01.165467 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-ff04f3a3-3bf0-45f8-9049-88130f8719f1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:01.166176 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-ff04f3a3-3bf0-45f8-9049-88130f8719f1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:01.166615 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-ff04f3a3-3bf0-45f8-9049-88130f8719f1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:01.301753 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-ff04f3a3-3bf0-45f8-9049-88130f8719f1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:01.311369 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-ff04f3a3-3bf0-45f8-9049-88130f8719f1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:01.313731 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-ff04f3a3-3bf0-45f8-9049-88130f8719f1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:01.315608 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-ff04f3a3-3bf0-45f8-9049-88130f8719f1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 200 len: 1721 microversion: 2.20 time: 0.162395 Aug 03 05:19:01.316879 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 358/752] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:19:01 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:19:01.660554 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-f0bf3570-ed57-4ea6-9eed-6876d0b7b706 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:01.661196 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-f0bf3570-ed57-4ea6-9eed-6876d0b7b706 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: ddb3fb62-23ee-4e46-b198-e30b98687d24] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:01.668722 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f0bf3570-ed57-4ea6-9eed-6876d0b7b706 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:01.670221 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f0bf3570-ed57-4ea6-9eed-6876d0b7b706 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:01.671111 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f0bf3570-ed57-4ea6-9eed-6876d0b7b706 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:01.671723 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f0bf3570-ed57-4ea6-9eed-6876d0b7b706 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:01.697719 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-f0bf3570-ed57-4ea6-9eed-6876d0b7b706 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24/ips" status: 200 len: 145 microversion: 2.1 time: 0.042751 Aug 03 05:19:01.698316 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 395/753] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Aug 3 05:19:01 2022] GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24/ips => generated 145 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:19:02.341275 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-71948fd6-1a28-43f8-a550-ba6f7a6e4642 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:02.342006 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-71948fd6-1a28-43f8-a550-ba6f7a6e4642 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:02.349600 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-71948fd6-1a28-43f8-a550-ba6f7a6e4642 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:02.350103 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-71948fd6-1a28-43f8-a550-ba6f7a6e4642 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:02.350908 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-71948fd6-1a28-43f8-a550-ba6f7a6e4642 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:02.351722 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-71948fd6-1a28-43f8-a550-ba6f7a6e4642 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:02.512252 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-71948fd6-1a28-43f8-a550-ba6f7a6e4642 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:02.520675 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-71948fd6-1a28-43f8-a550-ba6f7a6e4642 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:02.522182 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-71948fd6-1a28-43f8-a550-ba6f7a6e4642 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:02.523514 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-71948fd6-1a28-43f8-a550-ba6f7a6e4642 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 200 len: 1721 microversion: 2.20 time: 0.187419 Aug 03 05:19:02.524079 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 359/754] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:19:02 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 1721 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 05:19:03.394316 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-301ff400-104b-40a6-80bb-122919cff615 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c5dbeecd-1dd9-4e77-b0f8-17825c2ae852"}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:19:03.397053 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-301ff400-104b-40a6-80bb-122919cff615 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: ddb3fb62-23ee-4e46-b198-e30b98687d24] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:03.403625 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-301ff400-104b-40a6-80bb-122919cff615 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:03.404078 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-301ff400-104b-40a6-80bb-122919cff615 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:03.404843 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-301ff400-104b-40a6-80bb-122919cff615 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:03.405284 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-301ff400-104b-40a6-80bb-122919cff615 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:03.552733 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-466870ab-dc52-4414-98af-503f80607d73 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:03.553501 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-466870ab-dc52-4414-98af-503f80607d73 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:03.562538 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-466870ab-dc52-4414-98af-503f80607d73 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:03.563158 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-466870ab-dc52-4414-98af-503f80607d73 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:03.564040 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-466870ab-dc52-4414-98af-503f80607d73 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:03.564522 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-466870ab-dc52-4414-98af-503f80607d73 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:03.715935 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-466870ab-dc52-4414-98af-503f80607d73 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:03.726442 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-466870ab-dc52-4414-98af-503f80607d73 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:03.727988 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-466870ab-dc52-4414-98af-503f80607d73 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:03.729280 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-466870ab-dc52-4414-98af-503f80607d73 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 200 len: 1721 microversion: 2.20 time: 0.186878 Aug 03 05:19:03.730905 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 360/755] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:19:03 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 1721 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 05:19:04.144783 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-42f68645-d4bb-44eb-8d85-2b6a17df9302 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:19:04.145343 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-42f68645-d4bb-44eb-8d85-2b6a17df9302 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:04.153401 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-42f68645-d4bb-44eb-8d85-2b6a17df9302 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:04.154113 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-42f68645-d4bb-44eb-8d85-2b6a17df9302 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:04.155909 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-42f68645-d4bb-44eb-8d85-2b6a17df9302 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:04.156522 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-42f68645-d4bb-44eb-8d85-2b6a17df9302 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:04.195363 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.objects.instance [None req-42f68645-d4bb-44eb-8d85-2b6a17df9302 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lazy-loading 'flavor' on Instance uuid b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 {{(pid=118332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:19:04.262870 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-301ff400-104b-40a6-80bb-122919cff615 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "POST /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.871156 Aug 03 05:19:04.267212 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 396/756] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Aug 3 05:19:03 2022] POST /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24/os-volume_attachments => generated 194 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:19:04.598585 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-42f68645-d4bb-44eb-8d85-2b6a17df9302 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "POST /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0/action" status: 202 len: 0 microversion: 2.1 time: 0.465915 Aug 03 05:19:04.607689 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 361/757] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Aug 3 05:19:04 2022] POST /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0/action => generated 0 bytes in 471 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:19:04.608963 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-3e032c1a-94fc-4736-af0d-a2a18fa4470d tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:04.609651 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-3e032c1a-94fc-4736-af0d-a2a18fa4470d tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:04.620125 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3e032c1a-94fc-4736-af0d-a2a18fa4470d tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:04.621366 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3e032c1a-94fc-4736-af0d-a2a18fa4470d tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:04.622375 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3e032c1a-94fc-4736-af0d-a2a18fa4470d tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:04.623007 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3e032c1a-94fc-4736-af0d-a2a18fa4470d tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:04.773600 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-86c4fec4-c664-4c45-a4ea-49ceb3c10317 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:04.774537 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-86c4fec4-c664-4c45-a4ea-49ceb3c10317 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:04.788495 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-86c4fec4-c664-4c45-a4ea-49ceb3c10317 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:04.790684 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-86c4fec4-c664-4c45-a4ea-49ceb3c10317 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:04.791719 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-86c4fec4-c664-4c45-a4ea-49ceb3c10317 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:04.793332 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-86c4fec4-c664-4c45-a4ea-49ceb3c10317 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:05.089911 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-3e032c1a-94fc-4736-af0d-a2a18fa4470d tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:05.099128 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-3e032c1a-94fc-4736-af0d-a2a18fa4470d tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1568 microversion: 2.1 time: 0.494756 Aug 03 05:19:05.099718 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 397/758] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:04 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1568 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:05.135445 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-86c4fec4-c664-4c45-a4ea-49ceb3c10317 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:05.144155 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-86c4fec4-c664-4c45-a4ea-49ceb3c10317 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:05.145650 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-86c4fec4-c664-4c45-a4ea-49ceb3c10317 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:05.146930 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-86c4fec4-c664-4c45-a4ea-49ceb3c10317 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 200 len: 1721 microversion: 2.20 time: 0.396868 Aug 03 05:19:05.147494 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 362/759] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:19:04 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 1721 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:19:06.120406 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-20e29e43-9709-4429-af04-2b5b986ec2cb tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:06.121028 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-20e29e43-9709-4429-af04-2b5b986ec2cb tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:06.127886 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-20e29e43-9709-4429-af04-2b5b986ec2cb tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:06.128346 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-20e29e43-9709-4429-af04-2b5b986ec2cb tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:06.129126 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-20e29e43-9709-4429-af04-2b5b986ec2cb tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:06.129770 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-20e29e43-9709-4429-af04-2b5b986ec2cb tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:06.172830 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-dd2ed2f1-47bc-4123-a0c0-b2c8ee4837e3 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:06.173362 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-dd2ed2f1-47bc-4123-a0c0-b2c8ee4837e3 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:06.185131 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-dd2ed2f1-47bc-4123-a0c0-b2c8ee4837e3 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:06.185588 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-dd2ed2f1-47bc-4123-a0c0-b2c8ee4837e3 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:06.186376 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-dd2ed2f1-47bc-4123-a0c0-b2c8ee4837e3 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:06.186813 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-dd2ed2f1-47bc-4123-a0c0-b2c8ee4837e3 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:06.353687 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-20e29e43-9709-4429-af04-2b5b986ec2cb tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:06.361394 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-20e29e43-9709-4429-af04-2b5b986ec2cb tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1568 microversion: 2.1 time: 0.244785 Aug 03 05:19:06.361972 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 398/760] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:06 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1568 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:06.374764 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-dd2ed2f1-47bc-4123-a0c0-b2c8ee4837e3 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:06.382877 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-dd2ed2f1-47bc-4123-a0c0-b2c8ee4837e3 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:06.384892 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-dd2ed2f1-47bc-4123-a0c0-b2c8ee4837e3 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:06.385501 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-dd2ed2f1-47bc-4123-a0c0-b2c8ee4837e3 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 200 len: 1721 microversion: 2.20 time: 0.219778 Aug 03 05:19:06.386651 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 363/761] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:19:06 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 1721 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 05:19:07.383399 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-add2c95d-001e-4338-9cbc-667c6d36d9d9 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:07.384011 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-add2c95d-001e-4338-9cbc-667c6d36d9d9 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:07.391161 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-add2c95d-001e-4338-9cbc-667c6d36d9d9 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:07.391615 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-add2c95d-001e-4338-9cbc-667c6d36d9d9 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:07.392379 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-add2c95d-001e-4338-9cbc-667c6d36d9d9 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:07.392817 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-add2c95d-001e-4338-9cbc-667c6d36d9d9 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:07.408881 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-562e7aa0-0efa-4212-9288-37414eb0d929 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:07.409502 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-562e7aa0-0efa-4212-9288-37414eb0d929 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:07.409627 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:19:07.416075 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-562e7aa0-0efa-4212-9288-37414eb0d929 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:07.416527 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-562e7aa0-0efa-4212-9288-37414eb0d929 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:07.417358 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-562e7aa0-0efa-4212-9288-37414eb0d929 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:07.417802 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-562e7aa0-0efa-4212-9288-37414eb0d929 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:07.610766 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-add2c95d-001e-4338-9cbc-667c6d36d9d9 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:07.614789 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-562e7aa0-0efa-4212-9288-37414eb0d929 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:07.618387 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-add2c95d-001e-4338-9cbc-667c6d36d9d9 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1568 microversion: 2.1 time: 0.238823 Aug 03 05:19:07.619328 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 399/762] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:07 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1568 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:07.624440 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-562e7aa0-0efa-4212-9288-37414eb0d929 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:07.626024 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-562e7aa0-0efa-4212-9288-37414eb0d929 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:07.627213 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-562e7aa0-0efa-4212-9288-37414eb0d929 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 200 len: 1721 microversion: 2.20 time: 0.222306 Aug 03 05:19:07.627790 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 364/763] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:19:07 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 1721 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 05:19:08.641759 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-94dc6637-4692-4a5e-b6de-a196c5906a42 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:08.642402 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-94dc6637-4692-4a5e-b6de-a196c5906a42 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:08.650891 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-49c1a719-9a50-4601-9158-8d155a07d1f0 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:08.651516 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-94dc6637-4692-4a5e-b6de-a196c5906a42 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:08.651669 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-49c1a719-9a50-4601-9158-8d155a07d1f0 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:08.651981 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-94dc6637-4692-4a5e-b6de-a196c5906a42 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:08.652811 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-94dc6637-4692-4a5e-b6de-a196c5906a42 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:08.653251 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-94dc6637-4692-4a5e-b6de-a196c5906a42 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:08.658500 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-49c1a719-9a50-4601-9158-8d155a07d1f0 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:08.658983 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-49c1a719-9a50-4601-9158-8d155a07d1f0 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:08.659764 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-49c1a719-9a50-4601-9158-8d155a07d1f0 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:08.660319 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-49c1a719-9a50-4601-9158-8d155a07d1f0 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:08.862832 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-94dc6637-4692-4a5e-b6de-a196c5906a42 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:08.867258 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-49c1a719-9a50-4601-9158-8d155a07d1f0 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:08.870549 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-94dc6637-4692-4a5e-b6de-a196c5906a42 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1568 microversion: 2.1 time: 0.232658 Aug 03 05:19:08.871361 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 400/764] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:08 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1568 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:08.877168 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-49c1a719-9a50-4601-9158-8d155a07d1f0 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:08.878697 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-49c1a719-9a50-4601-9158-8d155a07d1f0 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:08.879896 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-49c1a719-9a50-4601-9158-8d155a07d1f0 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 200 len: 1721 microversion: 2.20 time: 0.233215 Aug 03 05:19:08.880458 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 365/765] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:19:08 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 1721 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 05:19:09.892468 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-f9b24546-292d-47ad-9952-758789064e75 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:09.895534 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-f9b24546-292d-47ad-9952-758789064e75 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:09.899799 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f9b24546-292d-47ad-9952-758789064e75 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:09.900322 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f9b24546-292d-47ad-9952-758789064e75 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:09.901110 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f9b24546-292d-47ad-9952-758789064e75 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:09.901605 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f9b24546-292d-47ad-9952-758789064e75 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:09.904587 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-10235ef6-7d43-4baa-b115-c5715b002102 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:09.905211 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-10235ef6-7d43-4baa-b115-c5715b002102 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:09.916160 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-10235ef6-7d43-4baa-b115-c5715b002102 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:09.916614 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-10235ef6-7d43-4baa-b115-c5715b002102 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:09.917932 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-10235ef6-7d43-4baa-b115-c5715b002102 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:09.918369 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-10235ef6-7d43-4baa-b115-c5715b002102 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:10.116430 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-f9b24546-292d-47ad-9952-758789064e75 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:10.124712 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-10235ef6-7d43-4baa-b115-c5715b002102 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:10.126584 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-f9b24546-292d-47ad-9952-758789064e75 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1568 microversion: 2.1 time: 0.237896 Aug 03 05:19:10.127620 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 401/766] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:09 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1568 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:10.136130 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-10235ef6-7d43-4baa-b115-c5715b002102 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:10.137877 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-10235ef6-7d43-4baa-b115-c5715b002102 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:10.139064 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-10235ef6-7d43-4baa-b115-c5715b002102 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 200 len: 1721 microversion: 2.20 time: 0.238337 Aug 03 05:19:10.140209 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 366/767] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:19:09 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 1721 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:19:11.148116 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-ff0d3f38-c959-4e73-aff3-576d9d4884be tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:11.148725 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-ff0d3f38-c959-4e73-aff3-576d9d4884be tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:11.156035 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ff0d3f38-c959-4e73-aff3-576d9d4884be tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:11.156225 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ff0d3f38-c959-4e73-aff3-576d9d4884be tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:11.157048 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ff0d3f38-c959-4e73-aff3-576d9d4884be tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:11.157510 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ff0d3f38-c959-4e73-aff3-576d9d4884be tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:11.165936 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-96df341b-3f29-4483-90b6-31bc137d2178 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:11.166932 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-96df341b-3f29-4483-90b6-31bc137d2178 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:11.178316 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-96df341b-3f29-4483-90b6-31bc137d2178 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:11.178938 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-96df341b-3f29-4483-90b6-31bc137d2178 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:11.179840 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-96df341b-3f29-4483-90b6-31bc137d2178 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:11.180394 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-96df341b-3f29-4483-90b6-31bc137d2178 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:11.369714 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-ff0d3f38-c959-4e73-aff3-576d9d4884be tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:11.378639 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-ff0d3f38-c959-4e73-aff3-576d9d4884be tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1568 microversion: 2.1 time: 0.234303 Aug 03 05:19:11.379471 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 402/768] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:11 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1568 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:11.382185 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-96df341b-3f29-4483-90b6-31bc137d2178 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:11.385688 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:19:11.391323 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-96df341b-3f29-4483-90b6-31bc137d2178 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:11.392843 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-96df341b-3f29-4483-90b6-31bc137d2178 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:11.394004 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-96df341b-3f29-4483-90b6-31bc137d2178 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 200 len: 1721 microversion: 2.20 time: 0.231958 Aug 03 05:19:11.394568 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 367/769] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:19:11 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 1721 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:19:11.831879 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-e3d5d392-894e-4926-b240-9f85a6c3bd00 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:11.834364 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-e3d5d392-894e-4926-b240-9f85a6c3bd00 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: ddb3fb62-23ee-4e46-b198-e30b98687d24] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:11.840865 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e3d5d392-894e-4926-b240-9f85a6c3bd00 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:11.841338 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e3d5d392-894e-4926-b240-9f85a6c3bd00 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:11.842089 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e3d5d392-894e-4926-b240-9f85a6c3bd00 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:11.842521 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e3d5d392-894e-4926-b240-9f85a6c3bd00 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:11.871183 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-e3d5d392-894e-4926-b240-9f85a6c3bd00 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043120 Aug 03 05:19:11.871741 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 403/770] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Aug 3 05:19:11 2022] GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:19:11.884281 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-fbacc172-7485-49c7-8b20-ed1923bfd2e6 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:11.884783 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-fbacc172-7485-49c7-8b20-ed1923bfd2e6 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: ddb3fb62-23ee-4e46-b198-e30b98687d24] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:11.891734 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-fbacc172-7485-49c7-8b20-ed1923bfd2e6 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:11.892195 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-fbacc172-7485-49c7-8b20-ed1923bfd2e6 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:11.892970 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-fbacc172-7485-49c7-8b20-ed1923bfd2e6 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:11.893412 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-fbacc172-7485-49c7-8b20-ed1923bfd2e6 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:11.927088 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-fbacc172-7485-49c7-8b20-ed1923bfd2e6 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24/os-volume_attachments/c5dbeecd-1dd9-4e77-b0f8-17825c2ae852" status: 200 len: 194 microversion: 2.1 time: 0.048451 Aug 03 05:19:11.927708 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 368/771] 10.222.0.40 () {58 vars in 1413 bytes} [Wed Aug 3 05:19:11 2022] GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24/os-volume_attachments/c5dbeecd-1dd9-4e77-b0f8-17825c2ae852 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:19:12.400687 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-6d30431d-80b5-4aaf-a9bb-9ca596561706 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:12.401292 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-6d30431d-80b5-4aaf-a9bb-9ca596561706 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:12.410437 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6d30431d-80b5-4aaf-a9bb-9ca596561706 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:12.410909 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6d30431d-80b5-4aaf-a9bb-9ca596561706 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:12.411680 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6d30431d-80b5-4aaf-a9bb-9ca596561706 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:12.412158 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6d30431d-80b5-4aaf-a9bb-9ca596561706 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:12.420329 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-01e8c396-3846-4c14-a71b-fc0d9cb40dd1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:12.420969 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-01e8c396-3846-4c14-a71b-fc0d9cb40dd1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:12.427964 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-01e8c396-3846-4c14-a71b-fc0d9cb40dd1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:12.428676 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-01e8c396-3846-4c14-a71b-fc0d9cb40dd1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:12.429451 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-01e8c396-3846-4c14-a71b-fc0d9cb40dd1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:12.429894 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-01e8c396-3846-4c14-a71b-fc0d9cb40dd1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:12.626629 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-6d30431d-80b5-4aaf-a9bb-9ca596561706 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:12.634095 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-01e8c396-3846-4c14-a71b-fc0d9cb40dd1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:12.634716 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-6d30431d-80b5-4aaf-a9bb-9ca596561706 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1568 microversion: 2.1 time: 0.238018 Aug 03 05:19:12.635658 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 404/772] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:12 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1568 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:12.646001 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-01e8c396-3846-4c14-a71b-fc0d9cb40dd1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:12.647543 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-01e8c396-3846-4c14-a71b-fc0d9cb40dd1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:12.648730 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-01e8c396-3846-4c14-a71b-fc0d9cb40dd1 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 200 len: 1742 microversion: 2.20 time: 0.232947 Aug 03 05:19:12.649300 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 369/773] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:19:12 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 1742 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 05:19:13.635522 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-1c1152d1-ee38-43df-aac7-5cda5a9f59e6 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7feba22a-ab28-428e-a1fc-8f6421681159"}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:19:13.638347 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-1c1152d1-ee38-43df-aac7-5cda5a9f59e6 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: ddb3fb62-23ee-4e46-b198-e30b98687d24] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:13.644973 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1c1152d1-ee38-43df-aac7-5cda5a9f59e6 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:13.645427 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1c1152d1-ee38-43df-aac7-5cda5a9f59e6 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:13.646206 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1c1152d1-ee38-43df-aac7-5cda5a9f59e6 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:13.646645 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1c1152d1-ee38-43df-aac7-5cda5a9f59e6 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:13.656052 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-6e33b946-b8ff-4675-ad5c-7226e2da30cd tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:13.656801 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-6e33b946-b8ff-4675-ad5c-7226e2da30cd tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:13.663474 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-6e33b946-b8ff-4675-ad5c-7226e2da30cd tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:13.664169 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-6e33b946-b8ff-4675-ad5c-7226e2da30cd tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:13.665205 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-6e33b946-b8ff-4675-ad5c-7226e2da30cd tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:13.665647 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-6e33b946-b8ff-4675-ad5c-7226e2da30cd tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:13.809833 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-6e33b946-b8ff-4675-ad5c-7226e2da30cd tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:13.817400 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-6e33b946-b8ff-4675-ad5c-7226e2da30cd tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1568 microversion: 2.1 time: 0.165711 Aug 03 05:19:13.817967 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 370/774] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:13 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:19:13.824996 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-75150d7c-ad05-4c33-8038-dfcc65c03144 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:13.825829 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-75150d7c-ad05-4c33-8038-dfcc65c03144 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:13.832859 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-75150d7c-ad05-4c33-8038-dfcc65c03144 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:13.836575 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-75150d7c-ad05-4c33-8038-dfcc65c03144 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:13.836575 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-75150d7c-ad05-4c33-8038-dfcc65c03144 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:13.836575 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-75150d7c-ad05-4c33-8038-dfcc65c03144 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:13.977452 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-75150d7c-ad05-4c33-8038-dfcc65c03144 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:13.986009 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-75150d7c-ad05-4c33-8038-dfcc65c03144 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:13.987572 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-75150d7c-ad05-4c33-8038-dfcc65c03144 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:13.988804 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-75150d7c-ad05-4c33-8038-dfcc65c03144 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 200 len: 1737 microversion: 2.20 time: 0.169862 Aug 03 05:19:13.989312 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 371/775] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:19:13 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 1737 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:19:14.540901 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-1c1152d1-ee38-43df-aac7-5cda5a9f59e6 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "POST /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.909422 Aug 03 05:19:14.542349 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 405/776] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Aug 3 05:19:13 2022] POST /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24/os-volume_attachments => generated 194 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:19:14.840921 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-23de53b3-558f-4ff7-8329-8792e7689032 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:14.841660 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-23de53b3-558f-4ff7-8329-8792e7689032 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:14.848982 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-23de53b3-558f-4ff7-8329-8792e7689032 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:14.849440 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-23de53b3-558f-4ff7-8329-8792e7689032 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:14.850229 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-23de53b3-558f-4ff7-8329-8792e7689032 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:14.850670 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-23de53b3-558f-4ff7-8329-8792e7689032 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:15.007770 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-23de53b3-558f-4ff7-8329-8792e7689032 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:15.020427 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-36faa54f-9f15-4645-8daa-9e40f3a2460d tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:15.021328 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-36faa54f-9f15-4645-8daa-9e40f3a2460d tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:15.023307 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-23de53b3-558f-4ff7-8329-8792e7689032 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1568 microversion: 2.1 time: 0.186108 Aug 03 05:19:15.029230 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-36faa54f-9f15-4645-8daa-9e40f3a2460d tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:15.030033 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-36faa54f-9f15-4645-8daa-9e40f3a2460d tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:15.031149 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-36faa54f-9f15-4645-8daa-9e40f3a2460d tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:15.031752 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-36faa54f-9f15-4645-8daa-9e40f3a2460d tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:15.038819 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 372/777] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:14 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1568 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:15.177361 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-36faa54f-9f15-4645-8daa-9e40f3a2460d tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:15.188059 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-36faa54f-9f15-4645-8daa-9e40f3a2460d tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:15.190129 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-36faa54f-9f15-4645-8daa-9e40f3a2460d tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:15.192138 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-36faa54f-9f15-4645-8daa-9e40f3a2460d tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 200 len: 1737 microversion: 2.20 time: 0.176880 Aug 03 05:19:15.192881 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 406/778] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:19:15 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 1737 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 05:19:15.614413 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [req-53b2ba87-6893-4e39-a672-37c066fe9729 req-e8334116-463d-4740-8663-fe4a68ca399e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67b3164b-4fb1-4812-94b7-cc60b3040700", "name": "network-vif-plugged", "status": "completed", "tag": "ac9d083a-77d7-4d9d-a0ea-ee7b9f6e3aab"}]} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:19:15.626467 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-53b2ba87-6893-4e39-a672-37c066fe9729 req-e8334116-463d-4740-8663-fe4a68ca399e service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:15.627050 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-53b2ba87-6893-4e39-a672-37c066fe9729 req-e8334116-463d-4740-8663-fe4a68ca399e service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:15.645221 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.compute.server_external_events [req-53b2ba87-6893-4e39-a672-37c066fe9729 req-e8334116-463d-4740-8663-fe4a68ca399e service nova] Creating event network-vif-plugged:ac9d083a-77d7-4d9d-a0ea-ee7b9f6e3aab for instance 67b3164b-4fb1-4812-94b7-cc60b3040700 on hv-cinder-85127 Aug 03 05:19:15.659402 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [req-53b2ba87-6893-4e39-a672-37c066fe9729 req-e8334116-463d-4740-8663-fe4a68ca399e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.222274 Aug 03 05:19:15.660338 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 373/779] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:19:16.045951 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-12ec9682-fbe6-427d-a02e-9fdd78efea9c tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:16.046558 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-12ec9682-fbe6-427d-a02e-9fdd78efea9c tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:16.056938 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-12ec9682-fbe6-427d-a02e-9fdd78efea9c tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:16.062368 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-12ec9682-fbe6-427d-a02e-9fdd78efea9c tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:16.062368 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-12ec9682-fbe6-427d-a02e-9fdd78efea9c tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:16.062368 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-12ec9682-fbe6-427d-a02e-9fdd78efea9c tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:16.219627 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-1cc6341e-09cb-48b9-92e6-d454d7a3d883 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:16.221215 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-1cc6341e-09cb-48b9-92e6-d454d7a3d883 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:16.226266 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-12ec9682-fbe6-427d-a02e-9fdd78efea9c tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:16.228642 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-1cc6341e-09cb-48b9-92e6-d454d7a3d883 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:16.230833 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-1cc6341e-09cb-48b9-92e6-d454d7a3d883 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:16.231970 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-1cc6341e-09cb-48b9-92e6-d454d7a3d883 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:16.233159 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-1cc6341e-09cb-48b9-92e6-d454d7a3d883 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:16.235229 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-12ec9682-fbe6-427d-a02e-9fdd78efea9c tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1568 microversion: 2.1 time: 0.193012 Aug 03 05:19:16.241611 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 407/780] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:16 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1568 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:16.398578 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-1cc6341e-09cb-48b9-92e6-d454d7a3d883 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:16.407990 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-1cc6341e-09cb-48b9-92e6-d454d7a3d883 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:16.409882 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-1cc6341e-09cb-48b9-92e6-d454d7a3d883 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:16.411040 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-1cc6341e-09cb-48b9-92e6-d454d7a3d883 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 200 len: 1737 microversion: 2.20 time: 0.197380 Aug 03 05:19:16.411770 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 374/781] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:19:16 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 1737 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 05:19:17.258659 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-808e68e7-2d43-4d74-82c5-86eaf9834fce tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:17.260065 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-808e68e7-2d43-4d74-82c5-86eaf9834fce tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:17.267652 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-808e68e7-2d43-4d74-82c5-86eaf9834fce tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:17.268113 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-808e68e7-2d43-4d74-82c5-86eaf9834fce tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:17.268928 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-808e68e7-2d43-4d74-82c5-86eaf9834fce tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:17.269685 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-808e68e7-2d43-4d74-82c5-86eaf9834fce tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:17.436425 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-7932f776-64f2-4847-a139-9cc8c4444324 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:17.436944 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-7932f776-64f2-4847-a139-9cc8c4444324 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:17.443602 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-7932f776-64f2-4847-a139-9cc8c4444324 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:17.444048 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-7932f776-64f2-4847-a139-9cc8c4444324 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:17.444813 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-7932f776-64f2-4847-a139-9cc8c4444324 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:17.445246 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-7932f776-64f2-4847-a139-9cc8c4444324 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:17.509637 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-808e68e7-2d43-4d74-82c5-86eaf9834fce tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:17.525889 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-808e68e7-2d43-4d74-82c5-86eaf9834fce tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1568 microversion: 2.1 time: 0.264102 Aug 03 05:19:17.525889 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 408/782] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:17 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1568 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:17.735193 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-7932f776-64f2-4847-a139-9cc8c4444324 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:17.744352 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-7932f776-64f2-4847-a139-9cc8c4444324 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:17.746750 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-7932f776-64f2-4847-a139-9cc8c4444324 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:17.748170 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-7932f776-64f2-4847-a139-9cc8c4444324 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 200 len: 1737 microversion: 2.20 time: 0.316025 Aug 03 05:19:17.750940 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 375/783] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:19:17 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 1737 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 05:19:18.545761 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-8c0cb477-f705-40f8-b687-b4d1910698e9 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:18.547494 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-8c0cb477-f705-40f8-b687-b4d1910698e9 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:18.561611 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8c0cb477-f705-40f8-b687-b4d1910698e9 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:18.562061 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8c0cb477-f705-40f8-b687-b4d1910698e9 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:18.562994 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8c0cb477-f705-40f8-b687-b4d1910698e9 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:18.563437 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8c0cb477-f705-40f8-b687-b4d1910698e9 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:18.747131 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-8c0cb477-f705-40f8-b687-b4d1910698e9 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:18.755226 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-8c0cb477-f705-40f8-b687-b4d1910698e9 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1568 microversion: 2.1 time: 0.217968 Aug 03 05:19:18.756444 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 409/784] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:18 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1568 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:18.787511 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-761a58ff-4410-439a-809f-a7e1287fd119 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:18.790525 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-761a58ff-4410-439a-809f-a7e1287fd119 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:18.798557 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-761a58ff-4410-439a-809f-a7e1287fd119 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:18.799466 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-761a58ff-4410-439a-809f-a7e1287fd119 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:18.800596 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-761a58ff-4410-439a-809f-a7e1287fd119 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:18.801210 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-761a58ff-4410-439a-809f-a7e1287fd119 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:19.004365 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-761a58ff-4410-439a-809f-a7e1287fd119 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:19.017260 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-761a58ff-4410-439a-809f-a7e1287fd119 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:19.029368 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-761a58ff-4410-439a-809f-a7e1287fd119 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:19.037884 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-761a58ff-4410-439a-809f-a7e1287fd119 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 200 len: 1737 microversion: 2.20 time: 0.258372 Aug 03 05:19:19.050902 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 376/785] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:19:18 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 1737 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 05:19:19.780961 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-5fe1e0d9-f1eb-4d3c-97dc-7d0cbf25feb7 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:19.799296 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-5fe1e0d9-f1eb-4d3c-97dc-7d0cbf25feb7 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:19.799296 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5fe1e0d9-f1eb-4d3c-97dc-7d0cbf25feb7 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:19.799296 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5fe1e0d9-f1eb-4d3c-97dc-7d0cbf25feb7 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:19.799296 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5fe1e0d9-f1eb-4d3c-97dc-7d0cbf25feb7 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:19.799736 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5fe1e0d9-f1eb-4d3c-97dc-7d0cbf25feb7 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:19.959754 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-5fe1e0d9-f1eb-4d3c-97dc-7d0cbf25feb7 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:19.970361 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-5fe1e0d9-f1eb-4d3c-97dc-7d0cbf25feb7 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1568 microversion: 2.1 time: 0.193976 Aug 03 05:19:19.971381 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 410/786] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:19 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1568 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:20.065981 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-409f0e07-3b9a-4f01-8f49-4a4e654b364a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:20.066671 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-409f0e07-3b9a-4f01-8f49-4a4e654b364a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:20.076289 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-409f0e07-3b9a-4f01-8f49-4a4e654b364a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:20.076839 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-409f0e07-3b9a-4f01-8f49-4a4e654b364a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:20.079358 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-409f0e07-3b9a-4f01-8f49-4a4e654b364a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:20.079939 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-409f0e07-3b9a-4f01-8f49-4a4e654b364a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:20.227036 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-409f0e07-3b9a-4f01-8f49-4a4e654b364a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:20.235985 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-409f0e07-3b9a-4f01-8f49-4a4e654b364a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:20.237584 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-409f0e07-3b9a-4f01-8f49-4a4e654b364a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:20.239081 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-409f0e07-3b9a-4f01-8f49-4a4e654b364a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 200 len: 1737 microversion: 2.20 time: 0.176944 Aug 03 05:19:20.239413 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 377/787] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:19:20 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 1737 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:19:20.994226 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-898a2c2a-b5e1-48cf-84ef-47ed5d8619d2 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:20.995619 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-898a2c2a-b5e1-48cf-84ef-47ed5d8619d2 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:21.002933 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-898a2c2a-b5e1-48cf-84ef-47ed5d8619d2 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:21.003703 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-898a2c2a-b5e1-48cf-84ef-47ed5d8619d2 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:21.004548 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-898a2c2a-b5e1-48cf-84ef-47ed5d8619d2 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:21.005057 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-898a2c2a-b5e1-48cf-84ef-47ed5d8619d2 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:21.193162 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-898a2c2a-b5e1-48cf-84ef-47ed5d8619d2 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:21.202764 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-898a2c2a-b5e1-48cf-84ef-47ed5d8619d2 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1568 microversion: 2.1 time: 0.215051 Aug 03 05:19:21.218693 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 411/788] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:20 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1568 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:21.269459 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-f2a6187b-d5dc-4b2d-bf08-dbfeb05c2a12 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:21.269993 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-f2a6187b-d5dc-4b2d-bf08-dbfeb05c2a12 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:21.277519 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f2a6187b-d5dc-4b2d-bf08-dbfeb05c2a12 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:21.278276 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f2a6187b-d5dc-4b2d-bf08-dbfeb05c2a12 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:21.279587 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f2a6187b-d5dc-4b2d-bf08-dbfeb05c2a12 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:21.280036 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f2a6187b-d5dc-4b2d-bf08-dbfeb05c2a12 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:21.442428 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-f2a6187b-d5dc-4b2d-bf08-dbfeb05c2a12 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:21.451243 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-f2a6187b-d5dc-4b2d-bf08-dbfeb05c2a12 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:21.453128 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-f2a6187b-d5dc-4b2d-bf08-dbfeb05c2a12 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:21.454771 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-f2a6187b-d5dc-4b2d-bf08-dbfeb05c2a12 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 200 len: 1737 microversion: 2.20 time: 0.189444 Aug 03 05:19:21.455315 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 378/789] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:19:21 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 1737 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:19:22.225035 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-257feaf7-d110-4347-9c1c-dcac3e7025ba tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:22.226375 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-257feaf7-d110-4347-9c1c-dcac3e7025ba tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:22.234980 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-257feaf7-d110-4347-9c1c-dcac3e7025ba tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:22.235440 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-257feaf7-d110-4347-9c1c-dcac3e7025ba tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:22.236822 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-257feaf7-d110-4347-9c1c-dcac3e7025ba tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:22.237255 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-257feaf7-d110-4347-9c1c-dcac3e7025ba tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:22.411896 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-257feaf7-d110-4347-9c1c-dcac3e7025ba tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:22.425312 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-257feaf7-d110-4347-9c1c-dcac3e7025ba tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1568 microversion: 2.1 time: 0.204341 Aug 03 05:19:22.425911 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 412/790] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:22 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1568 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:22.482151 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-778d92c5-8b57-4421-9fcd-aa74a7c01692 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:22.483479 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-778d92c5-8b57-4421-9fcd-aa74a7c01692 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:22.491929 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-778d92c5-8b57-4421-9fcd-aa74a7c01692 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:22.492475 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-778d92c5-8b57-4421-9fcd-aa74a7c01692 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:22.493342 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-778d92c5-8b57-4421-9fcd-aa74a7c01692 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:22.494013 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-778d92c5-8b57-4421-9fcd-aa74a7c01692 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:22.645384 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-778d92c5-8b57-4421-9fcd-aa74a7c01692 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:22.655000 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-778d92c5-8b57-4421-9fcd-aa74a7c01692 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:22.658011 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-778d92c5-8b57-4421-9fcd-aa74a7c01692 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:22.660517 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-778d92c5-8b57-4421-9fcd-aa74a7c01692 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 200 len: 1737 microversion: 2.20 time: 0.183126 Aug 03 05:19:22.661249 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 379/791] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:19:22 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 1737 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:19:23.371037 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-12975504-2bbd-42bf-8be9-5e222ed4a594 req-896aeeeb-02d6-4160-87f8-cb88e2bb54bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0", "name": "network-vif-unplugged", "status": "completed", "tag": "255ebc2e-922a-4b85-be40-f642cc2ae298"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:19:23.376448 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-12975504-2bbd-42bf-8be9-5e222ed4a594 req-896aeeeb-02d6-4160-87f8-cb88e2bb54bf service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:23.376805 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-12975504-2bbd-42bf-8be9-5e222ed4a594 req-896aeeeb-02d6-4160-87f8-cb88e2bb54bf service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:23.389786 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-12975504-2bbd-42bf-8be9-5e222ed4a594 req-896aeeeb-02d6-4160-87f8-cb88e2bb54bf service nova] Creating event network-vif-unplugged:255ebc2e-922a-4b85-be40-f642cc2ae298 for instance b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 on hv-cinder-85127 Aug 03 05:19:23.398665 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-12975504-2bbd-42bf-8be9-5e222ed4a594 req-896aeeeb-02d6-4160-87f8-cb88e2bb54bf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044638 Aug 03 05:19:23.401639 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 413/792] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:19:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:19:23.454657 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-e09807a9-8017-4dff-a524-2c15fceb8d3f tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:23.455353 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-e09807a9-8017-4dff-a524-2c15fceb8d3f tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:23.474777 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e09807a9-8017-4dff-a524-2c15fceb8d3f tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:23.475970 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e09807a9-8017-4dff-a524-2c15fceb8d3f tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:23.477697 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e09807a9-8017-4dff-a524-2c15fceb8d3f tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:23.479984 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e09807a9-8017-4dff-a524-2c15fceb8d3f tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:23.642636 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-e09807a9-8017-4dff-a524-2c15fceb8d3f tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:23.650410 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-e09807a9-8017-4dff-a524-2c15fceb8d3f tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1569 microversion: 2.1 time: 0.204782 Aug 03 05:19:23.651014 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 380/793] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:23 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1569 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:23.680102 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-e5bd7114-4c43-47d4-89bc-85c5e70d1bd0 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:19:23.680604 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-e5bd7114-4c43-47d4-89bc-85c5e70d1bd0 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:23.683937 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-75c9e837-56af-4e18-898a-54edae975e02 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:23.684556 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-75c9e837-56af-4e18-898a-54edae975e02 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:23.688742 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e5bd7114-4c43-47d4-89bc-85c5e70d1bd0 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:23.689208 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e5bd7114-4c43-47d4-89bc-85c5e70d1bd0 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:23.689991 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e5bd7114-4c43-47d4-89bc-85c5e70d1bd0 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:23.690438 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e5bd7114-4c43-47d4-89bc-85c5e70d1bd0 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:23.691011 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-75c9e837-56af-4e18-898a-54edae975e02 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:23.691458 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-75c9e837-56af-4e18-898a-54edae975e02 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:23.692231 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-75c9e837-56af-4e18-898a-54edae975e02 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:23.692670 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-75c9e837-56af-4e18-898a-54edae975e02 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:23.720966 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-e5bd7114-4c43-47d4-89bc-85c5e70d1bd0 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118331) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 03 05:19:23.827484 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-75c9e837-56af-4e18-898a-54edae975e02 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:23.835851 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-75c9e837-56af-4e18-898a-54edae975e02 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:23.837363 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-75c9e837-56af-4e18-898a-54edae975e02 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:23.838522 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-75c9e837-56af-4e18-898a-54edae975e02 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 200 len: 1737 microversion: 2.20 time: 0.158417 Aug 03 05:19:23.839641 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 381/794] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:19:23 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 05:19:23.898070 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:19:24.164752 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-e5bd7114-4c43-47d4-89bc-85c5e70d1bd0 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "POST /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0/action" status: 202 len: 0 microversion: 2.1 time: 0.489379 Aug 03 05:19:24.168259 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 414/795] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Aug 3 05:19:23 2022] POST /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0/action => generated 0 bytes in 494 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 05:19:24.179986 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-558ae673-87a2-4042-9f1f-8c193cdda993 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:24.180943 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-558ae673-87a2-4042-9f1f-8c193cdda993 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:24.187685 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-558ae673-87a2-4042-9f1f-8c193cdda993 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:24.188186 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-558ae673-87a2-4042-9f1f-8c193cdda993 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:24.189023 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-558ae673-87a2-4042-9f1f-8c193cdda993 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:24.189531 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-558ae673-87a2-4042-9f1f-8c193cdda993 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:24.394540 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-558ae673-87a2-4042-9f1f-8c193cdda993 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:24.402957 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-558ae673-87a2-4042-9f1f-8c193cdda993 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1517 microversion: 2.1 time: 0.229352 Aug 03 05:19:24.415780 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 382/796] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:24 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1517 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:24.862708 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-0f85c56d-83ed-4e05-b0a9-b5010c696508 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:24.863662 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-0f85c56d-83ed-4e05-b0a9-b5010c696508 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:24.870366 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0f85c56d-83ed-4e05-b0a9-b5010c696508 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:24.871048 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0f85c56d-83ed-4e05-b0a9-b5010c696508 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:24.872062 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0f85c56d-83ed-4e05-b0a9-b5010c696508 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:24.872589 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0f85c56d-83ed-4e05-b0a9-b5010c696508 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:25.027057 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-0f85c56d-83ed-4e05-b0a9-b5010c696508 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:25.036595 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-0f85c56d-83ed-4e05-b0a9-b5010c696508 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:25.038332 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-0f85c56d-83ed-4e05-b0a9-b5010c696508 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:25.040085 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-0f85c56d-83ed-4e05-b0a9-b5010c696508 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 200 len: 1737 microversion: 2.20 time: 0.181969 Aug 03 05:19:25.054867 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 415/797] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:19:24 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 1737 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:19:25.426823 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-3678467f-3936-4e80-a4ea-8f18b7f8d914 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:25.428206 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-3678467f-3936-4e80-a4ea-8f18b7f8d914 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:25.443832 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3678467f-3936-4e80-a4ea-8f18b7f8d914 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:25.443832 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3678467f-3936-4e80-a4ea-8f18b7f8d914 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:25.443832 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3678467f-3936-4e80-a4ea-8f18b7f8d914 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:25.443832 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3678467f-3936-4e80-a4ea-8f18b7f8d914 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:25.471114 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-48983afd-6060-48b2-b4e0-3fe25713e934 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:25.473492 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-48983afd-6060-48b2-b4e0-3fe25713e934 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: ddb3fb62-23ee-4e46-b198-e30b98687d24] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:25.483911 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-48983afd-6060-48b2-b4e0-3fe25713e934 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:25.484608 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-48983afd-6060-48b2-b4e0-3fe25713e934 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:25.485568 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-48983afd-6060-48b2-b4e0-3fe25713e934 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:25.486286 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-48983afd-6060-48b2-b4e0-3fe25713e934 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:25.518467 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-48983afd-6060-48b2-b4e0-3fe25713e934 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.052544 Aug 03 05:19:25.519087 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 416/798] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Aug 3 05:19:25 2022] GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24/os-volume_attachments => generated 371 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:19:25.610327 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-3678467f-3936-4e80-a4ea-8f18b7f8d914 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:25.623549 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-3678467f-3936-4e80-a4ea-8f18b7f8d914 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1519 microversion: 2.1 time: 0.202423 Aug 03 05:19:25.624680 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 383/799] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:25 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1519 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:25.670869 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-33ee3425-f2d2-4789-8e97-7b0bf53b1200 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:25.671613 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-33ee3425-f2d2-4789-8e97-7b0bf53b1200 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: ddb3fb62-23ee-4e46-b198-e30b98687d24] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:25.678887 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-33ee3425-f2d2-4789-8e97-7b0bf53b1200 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:25.679486 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-33ee3425-f2d2-4789-8e97-7b0bf53b1200 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:25.680538 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-33ee3425-f2d2-4789-8e97-7b0bf53b1200 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:25.680986 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-33ee3425-f2d2-4789-8e97-7b0bf53b1200 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:25.710627 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-33ee3425-f2d2-4789-8e97-7b0bf53b1200 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24/os-volume_attachments/c5dbeecd-1dd9-4e77-b0f8-17825c2ae852" status: 200 len: 194 microversion: 2.1 time: 0.053764 Aug 03 05:19:25.711292 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 417/800] 10.222.0.40 () {58 vars in 1413 bytes} [Wed Aug 3 05:19:25 2022] GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24/os-volume_attachments/c5dbeecd-1dd9-4e77-b0f8-17825c2ae852 => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:19:25.722544 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-a4b7def2-ef8c-4215-a425-0f130d959c5f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:25.723070 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-a4b7def2-ef8c-4215-a425-0f130d959c5f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: ddb3fb62-23ee-4e46-b198-e30b98687d24] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:25.729110 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-a4b7def2-ef8c-4215-a425-0f130d959c5f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:25.729569 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-a4b7def2-ef8c-4215-a425-0f130d959c5f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:25.730340 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-a4b7def2-ef8c-4215-a425-0f130d959c5f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:25.730789 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-a4b7def2-ef8c-4215-a425-0f130d959c5f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:25.810573 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.objects.instance [None req-a4b7def2-ef8c-4215-a425-0f130d959c5f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lazy-loading 'services' on Instance uuid ddb3fb62-23ee-4e46-b198-e30b98687d24 {{(pid=118332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:19:25.814202 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_cell1:SELECT=100 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:19:26.064142 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-63d83211-f852-4ef2-a7dc-17ef8d870948 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:26.064860 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-63d83211-f852-4ef2-a7dc-17ef8d870948 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:26.066476 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-a4b7def2-ef8c-4215-a425-0f130d959c5f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24/os-volume_attachments/c5dbeecd-1dd9-4e77-b0f8-17825c2ae852" status: 202 len: 0 microversion: 2.1 time: 0.347792 Aug 03 05:19:26.067191 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 384/801] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Aug 3 05:19:25 2022] DELETE /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24/os-volume_attachments/c5dbeecd-1dd9-4e77-b0f8-17825c2ae852 => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:19:26.071724 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-63d83211-f852-4ef2-a7dc-17ef8d870948 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:26.076398 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-63d83211-f852-4ef2-a7dc-17ef8d870948 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:26.076398 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-63d83211-f852-4ef2-a7dc-17ef8d870948 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:26.076398 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-63d83211-f852-4ef2-a7dc-17ef8d870948 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:26.203292 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-63d83211-f852-4ef2-a7dc-17ef8d870948 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:26.211357 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-63d83211-f852-4ef2-a7dc-17ef8d870948 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:26.212871 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-63d83211-f852-4ef2-a7dc-17ef8d870948 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:26.214028 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-63d83211-f852-4ef2-a7dc-17ef8d870948 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 200 len: 1719 microversion: 2.20 time: 0.153836 Aug 03 05:19:26.214590 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 418/802] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:19:26 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 1719 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 05:19:26.648648 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-37859a8b-db9f-4901-8a72-06f2051fa0e3 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:26.649346 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-37859a8b-db9f-4901-8a72-06f2051fa0e3 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:26.656404 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-37859a8b-db9f-4901-8a72-06f2051fa0e3 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:26.659280 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-37859a8b-db9f-4901-8a72-06f2051fa0e3 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:26.659280 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-37859a8b-db9f-4901-8a72-06f2051fa0e3 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:26.659280 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-37859a8b-db9f-4901-8a72-06f2051fa0e3 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:26.824459 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-37859a8b-db9f-4901-8a72-06f2051fa0e3 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:26.831993 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-37859a8b-db9f-4901-8a72-06f2051fa0e3 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1519 microversion: 2.1 time: 0.188188 Aug 03 05:19:26.832861 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 385/803] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:26 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1519 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:27.237049 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-6bc99a97-820e-4965-8fc8-06bd8f076034 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:27.237658 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-6bc99a97-820e-4965-8fc8-06bd8f076034 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:27.244130 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6bc99a97-820e-4965-8fc8-06bd8f076034 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:27.244582 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6bc99a97-820e-4965-8fc8-06bd8f076034 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:27.245345 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6bc99a97-820e-4965-8fc8-06bd8f076034 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:27.245788 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6bc99a97-820e-4965-8fc8-06bd8f076034 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:27.372419 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-6bc99a97-820e-4965-8fc8-06bd8f076034 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:27.380263 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-6bc99a97-820e-4965-8fc8-06bd8f076034 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:27.381719 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-6bc99a97-820e-4965-8fc8-06bd8f076034 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:27.382888 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-6bc99a97-820e-4965-8fc8-06bd8f076034 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 200 len: 1719 microversion: 2.20 time: 0.149705 Aug 03 05:19:27.383451 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 419/804] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:19:27 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 1719 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:19:27.854095 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-aa07a846-e75d-4d37-a80f-257bd57f37d0 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:27.855245 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-aa07a846-e75d-4d37-a80f-257bd57f37d0 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:27.861666 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-aa07a846-e75d-4d37-a80f-257bd57f37d0 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:27.862111 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-aa07a846-e75d-4d37-a80f-257bd57f37d0 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:27.862880 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-aa07a846-e75d-4d37-a80f-257bd57f37d0 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:27.863316 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-aa07a846-e75d-4d37-a80f-257bd57f37d0 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:27.995156 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-aa07a846-e75d-4d37-a80f-257bd57f37d0 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:28.002695 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-aa07a846-e75d-4d37-a80f-257bd57f37d0 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1519 microversion: 2.1 time: 0.152511 Aug 03 05:19:28.003300 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 386/805] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:27 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:28.406219 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-5ef124f8-9ff0-497c-9efb-77f5904ccbcf tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:28.406828 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-5ef124f8-9ff0-497c-9efb-77f5904ccbcf tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:28.413764 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5ef124f8-9ff0-497c-9efb-77f5904ccbcf tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:28.414274 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5ef124f8-9ff0-497c-9efb-77f5904ccbcf tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:28.415109 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5ef124f8-9ff0-497c-9efb-77f5904ccbcf tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:28.415552 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5ef124f8-9ff0-497c-9efb-77f5904ccbcf tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:28.630599 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-5ef124f8-9ff0-497c-9efb-77f5904ccbcf tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:28.639336 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-5ef124f8-9ff0-497c-9efb-77f5904ccbcf tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:28.640874 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-5ef124f8-9ff0-497c-9efb-77f5904ccbcf tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:28.642360 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-5ef124f8-9ff0-497c-9efb-77f5904ccbcf tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 200 len: 1719 microversion: 2.20 time: 0.240004 Aug 03 05:19:28.643146 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 420/806] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:19:28 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 1719 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:19:29.024581 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-67f5c031-1f08-4106-9af2-07d3911be246 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:29.025278 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-67f5c031-1f08-4106-9af2-07d3911be246 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:29.032267 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-67f5c031-1f08-4106-9af2-07d3911be246 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:29.032713 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-67f5c031-1f08-4106-9af2-07d3911be246 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:29.033517 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-67f5c031-1f08-4106-9af2-07d3911be246 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:29.033956 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-67f5c031-1f08-4106-9af2-07d3911be246 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:29.171091 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-67f5c031-1f08-4106-9af2-07d3911be246 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:29.178528 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-67f5c031-1f08-4106-9af2-07d3911be246 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1519 microversion: 2.1 time: 0.157887 Aug 03 05:19:29.179191 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 387/807] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:29 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:29.321413 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-4e0f388e-4451-4f55-88fc-f870c0dae6ed req-7e242f27-79f1-4031-b615-8babc404f620 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67b3164b-4fb1-4812-94b7-cc60b3040700", "name": "network-vif-unplugged", "status": "completed", "tag": "ac9d083a-77d7-4d9d-a0ea-ee7b9f6e3aab"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:19:29.331499 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-4e0f388e-4451-4f55-88fc-f870c0dae6ed req-7e242f27-79f1-4031-b615-8babc404f620 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:29.331957 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-4e0f388e-4451-4f55-88fc-f870c0dae6ed req-7e242f27-79f1-4031-b615-8babc404f620 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:29.343389 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-4e0f388e-4451-4f55-88fc-f870c0dae6ed req-7e242f27-79f1-4031-b615-8babc404f620 service nova] Creating event network-vif-unplugged:ac9d083a-77d7-4d9d-a0ea-ee7b9f6e3aab for instance 67b3164b-4fb1-4812-94b7-cc60b3040700 on hv-cinder-85127 Aug 03 05:19:29.348222 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-4e0f388e-4451-4f55-88fc-f870c0dae6ed req-7e242f27-79f1-4031-b615-8babc404f620 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030591 Aug 03 05:19:29.348799 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 421/808] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:19:29.666165 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-68b3f023-45bf-4b01-9a4c-df4ae9622a8b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:29.666783 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-68b3f023-45bf-4b01-9a4c-df4ae9622a8b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:29.672980 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-68b3f023-45bf-4b01-9a4c-df4ae9622a8b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:29.673444 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-68b3f023-45bf-4b01-9a4c-df4ae9622a8b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:29.674260 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-68b3f023-45bf-4b01-9a4c-df4ae9622a8b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:29.674704 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-68b3f023-45bf-4b01-9a4c-df4ae9622a8b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:29.811358 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-68b3f023-45bf-4b01-9a4c-df4ae9622a8b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:29.819537 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-68b3f023-45bf-4b01-9a4c-df4ae9622a8b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:29.820984 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-68b3f023-45bf-4b01-9a4c-df4ae9622a8b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:29.822154 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-68b3f023-45bf-4b01-9a4c-df4ae9622a8b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 200 len: 1719 microversion: 2.20 time: 0.159983 Aug 03 05:19:29.822707 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 388/809] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:19:29 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 1719 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:19:30.201351 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-63b1ce36-3d3b-4144-b965-bd82510617b1 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:30.202180 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-63b1ce36-3d3b-4144-b965-bd82510617b1 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:30.208909 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-63b1ce36-3d3b-4144-b965-bd82510617b1 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:30.209362 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-63b1ce36-3d3b-4144-b965-bd82510617b1 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:30.210135 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-63b1ce36-3d3b-4144-b965-bd82510617b1 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:30.210578 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-63b1ce36-3d3b-4144-b965-bd82510617b1 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:30.351633 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-63b1ce36-3d3b-4144-b965-bd82510617b1 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:30.359456 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-63b1ce36-3d3b-4144-b965-bd82510617b1 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1519 microversion: 2.1 time: 0.162811 Aug 03 05:19:30.360025 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 422/810] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:30 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:30.846012 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-72d833b1-498c-4dc0-a351-51d2c1bc12b3 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:30.846627 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-72d833b1-498c-4dc0-a351-51d2c1bc12b3 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:30.853075 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-72d833b1-498c-4dc0-a351-51d2c1bc12b3 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:30.853538 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-72d833b1-498c-4dc0-a351-51d2c1bc12b3 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:30.854301 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-72d833b1-498c-4dc0-a351-51d2c1bc12b3 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:30.854745 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-72d833b1-498c-4dc0-a351-51d2c1bc12b3 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:30.991091 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-72d833b1-498c-4dc0-a351-51d2c1bc12b3 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:30.999520 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-72d833b1-498c-4dc0-a351-51d2c1bc12b3 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:31.001016 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-72d833b1-498c-4dc0-a351-51d2c1bc12b3 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:31.002197 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-72d833b1-498c-4dc0-a351-51d2c1bc12b3 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 200 len: 1722 microversion: 2.20 time: 0.160114 Aug 03 05:19:31.002756 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 389/811] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:19:30 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:19:31.025738 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-66f804f8-b8ce-40ad-b4b6-1eab6adb1339 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9a8cb7e8-fefa-4c6f-8868-0dccc0defdca"}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:19:31.028681 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-66f804f8-b8ce-40ad-b4b6-1eab6adb1339 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:31.034558 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-66f804f8-b8ce-40ad-b4b6-1eab6adb1339 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:31.035066 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-66f804f8-b8ce-40ad-b4b6-1eab6adb1339 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:31.035826 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-66f804f8-b8ce-40ad-b4b6-1eab6adb1339 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:31.036259 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-66f804f8-b8ce-40ad-b4b6-1eab6adb1339 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:31.382934 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-952ab001-64fe-4884-b5e7-c4d9ee1bbd57 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:31.383974 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-952ab001-64fe-4884-b5e7-c4d9ee1bbd57 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:31.392177 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-952ab001-64fe-4884-b5e7-c4d9ee1bbd57 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:31.392632 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-952ab001-64fe-4884-b5e7-c4d9ee1bbd57 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:31.393587 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-952ab001-64fe-4884-b5e7-c4d9ee1bbd57 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:31.394134 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-952ab001-64fe-4884-b5e7-c4d9ee1bbd57 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:31.637033 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-952ab001-64fe-4884-b5e7-c4d9ee1bbd57 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:31.644868 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-952ab001-64fe-4884-b5e7-c4d9ee1bbd57 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1575 microversion: 2.1 time: 0.267211 Aug 03 05:19:31.645617 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 390/812] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:31 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1575 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:31.650622 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-745ddb43-b6d7-4bca-ab16-5da510a1293d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:31.651166 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-745ddb43-b6d7-4bca-ab16-5da510a1293d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: ddb3fb62-23ee-4e46-b198-e30b98687d24] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:31.657307 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-745ddb43-b6d7-4bca-ab16-5da510a1293d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:31.657769 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-745ddb43-b6d7-4bca-ab16-5da510a1293d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:31.658544 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-745ddb43-b6d7-4bca-ab16-5da510a1293d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:31.659254 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-745ddb43-b6d7-4bca-ab16-5da510a1293d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:31.692636 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-745ddb43-b6d7-4bca-ab16-5da510a1293d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24/os-volume_attachments/7feba22a-ab28-428e-a1fc-8f6421681159" status: 200 len: 194 microversion: 2.1 time: 0.045705 Aug 03 05:19:31.693492 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 391/813] 10.222.0.40 () {58 vars in 1413 bytes} [Wed Aug 3 05:19:31 2022] GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24/os-volume_attachments/7feba22a-ab28-428e-a1fc-8f6421681159 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:19:31.703811 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-4cf9554a-45b6-4874-b08a-f934ca2fa4cb tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:31.704444 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-4cf9554a-45b6-4874-b08a-f934ca2fa4cb tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: ddb3fb62-23ee-4e46-b198-e30b98687d24] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:31.711045 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-4cf9554a-45b6-4874-b08a-f934ca2fa4cb tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:31.711565 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-4cf9554a-45b6-4874-b08a-f934ca2fa4cb tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:31.712335 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-4cf9554a-45b6-4874-b08a-f934ca2fa4cb tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:31.712773 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-4cf9554a-45b6-4874-b08a-f934ca2fa4cb tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:31.801084 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.objects.instance [None req-4cf9554a-45b6-4874-b08a-f934ca2fa4cb tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lazy-loading 'services' on Instance uuid ddb3fb62-23ee-4e46-b198-e30b98687d24 {{(pid=118332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:19:32.037820 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-4cf9554a-45b6-4874-b08a-f934ca2fa4cb tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24/os-volume_attachments/7feba22a-ab28-428e-a1fc-8f6421681159" status: 202 len: 0 microversion: 2.1 time: 0.337511 Aug 03 05:19:32.038454 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 392/814] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Aug 3 05:19:31 2022] DELETE /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24/os-volume_attachments/7feba22a-ab28-428e-a1fc-8f6421681159 => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 05:19:32.169236 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-66f804f8-b8ce-40ad-b4b6-1eab6adb1339 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "POST /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.147585 Aug 03 05:19:32.170009 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 423/815] 10.222.0.40 () {62 vars in 1364 bytes} [Wed Aug 3 05:19:31 2022] POST /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700/os-volume_attachments => generated 188 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 05:19:32.291941 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-2d4dacc6-770a-475a-8b3c-2df6d18a006b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:32.292460 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-2d4dacc6-770a-475a-8b3c-2df6d18a006b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:32.298691 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-2d4dacc6-770a-475a-8b3c-2df6d18a006b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:32.299190 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-2d4dacc6-770a-475a-8b3c-2df6d18a006b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:32.299959 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-2d4dacc6-770a-475a-8b3c-2df6d18a006b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:32.300398 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-2d4dacc6-770a-475a-8b3c-2df6d18a006b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:32.665627 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-e2b5809a-ec3f-4e54-ab2e-5a51ccd05d9d tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:32.666264 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-e2b5809a-ec3f-4e54-ab2e-5a51ccd05d9d tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:32.669345 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:19:32.675075 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e2b5809a-ec3f-4e54-ab2e-5a51ccd05d9d tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:32.675538 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e2b5809a-ec3f-4e54-ab2e-5a51ccd05d9d tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:32.676314 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e2b5809a-ec3f-4e54-ab2e-5a51ccd05d9d tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:32.676761 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e2b5809a-ec3f-4e54-ab2e-5a51ccd05d9d tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:32.809791 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-e2b5809a-ec3f-4e54-ab2e-5a51ccd05d9d tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:32.817122 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-e2b5809a-ec3f-4e54-ab2e-5a51ccd05d9d tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1575 microversion: 2.1 time: 0.155452 Aug 03 05:19:32.819824 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 424/816] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:32 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:33.839061 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-4c25c7e8-c0fc-4036-aeb1-256772e149a8 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:33.840342 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-4c25c7e8-c0fc-4036-aeb1-256772e149a8 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:33.846768 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4c25c7e8-c0fc-4036-aeb1-256772e149a8 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:33.847252 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4c25c7e8-c0fc-4036-aeb1-256772e149a8 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:33.848020 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4c25c7e8-c0fc-4036-aeb1-256772e149a8 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:33.848463 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4c25c7e8-c0fc-4036-aeb1-256772e149a8 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:33.866342 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-2d4dacc6-770a-475a-8b3c-2df6d18a006b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "DELETE /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700/os-volume_attachments/9a8cb7e8-fefa-4c6f-8868-0dccc0defdca" status: 202 len: 0 microversion: 2.20 time: 1.578715 Aug 03 05:19:33.866998 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 393/817] 10.222.0.40 () {60 vars in 1457 bytes} [Wed Aug 3 05:19:32 2022] DELETE /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700/os-volume_attachments/9a8cb7e8-fefa-4c6f-8868-0dccc0defdca => generated 0 bytes in 1580 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:19:33.928274 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-b720330e-2b4a-4486-b280-7c0c797f1565 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:19:33.928877 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-b720330e-2b4a-4486-b280-7c0c797f1565 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:33.930816 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_api:SELECT=74 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:19:33.936276 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b720330e-2b4a-4486-b280-7c0c797f1565 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:33.936753 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b720330e-2b4a-4486-b280-7c0c797f1565 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:33.937525 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b720330e-2b4a-4486-b280-7c0c797f1565 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:33.937969 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b720330e-2b4a-4486-b280-7c0c797f1565 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:33.989672 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-4c25c7e8-c0fc-4036-aeb1-256772e149a8 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:33.997225 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-4c25c7e8-c0fc-4036-aeb1-256772e149a8 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1575 microversion: 2.1 time: 0.162137 Aug 03 05:19:33.997840 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 425/818] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:33 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:19:34.086593 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-b720330e-2b4a-4486-b280-7c0c797f1565 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118332) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 03 05:19:34.310302 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-b720330e-2b4a-4486-b280-7c0c797f1565 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "POST /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700/action" status: 202 len: 0 microversion: 2.20 time: 0.386040 Aug 03 05:19:34.310940 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 394/819] 10.222.0.40 () {62 vars in 1319 bytes} [Wed Aug 3 05:19:33 2022] POST /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700/action => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 03 05:19:34.319275 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-855ca5d5-653f-411c-8108-7f1c66479bb3 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:34.320023 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-855ca5d5-653f-411c-8108-7f1c66479bb3 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:34.326946 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-855ca5d5-653f-411c-8108-7f1c66479bb3 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:34.327407 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-855ca5d5-653f-411c-8108-7f1c66479bb3 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:34.328188 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-855ca5d5-653f-411c-8108-7f1c66479bb3 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:34.328631 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-855ca5d5-653f-411c-8108-7f1c66479bb3 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:34.467936 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-855ca5d5-653f-411c-8108-7f1c66479bb3 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:34.476715 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-855ca5d5-653f-411c-8108-7f1c66479bb3 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:34.478240 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-855ca5d5-653f-411c-8108-7f1c66479bb3 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:34.479437 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-855ca5d5-653f-411c-8108-7f1c66479bb3 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 200 len: 1670 microversion: 2.20 time: 0.164346 Aug 03 05:19:34.480023 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 426/820] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:19:34 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 1670 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:19:35.018123 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-de561d15-f1f5-4074-9d93-611a1825fa7c tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:35.019365 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-de561d15-f1f5-4074-9d93-611a1825fa7c tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:35.025426 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-de561d15-f1f5-4074-9d93-611a1825fa7c tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:35.025879 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-de561d15-f1f5-4074-9d93-611a1825fa7c tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:35.026653 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-de561d15-f1f5-4074-9d93-611a1825fa7c tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:35.027632 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-de561d15-f1f5-4074-9d93-611a1825fa7c tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:35.203502 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-de561d15-f1f5-4074-9d93-611a1825fa7c tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:35.212434 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-de561d15-f1f5-4074-9d93-611a1825fa7c tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1575 microversion: 2.1 time: 0.198040 Aug 03 05:19:35.213052 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 395/821] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:35 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1575 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:35.503556 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-42ea2c88-c414-43ad-9025-73212185fd22 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:35.505060 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-42ea2c88-c414-43ad-9025-73212185fd22 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:35.513321 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-42ea2c88-c414-43ad-9025-73212185fd22 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:35.513995 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-42ea2c88-c414-43ad-9025-73212185fd22 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:35.515183 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-42ea2c88-c414-43ad-9025-73212185fd22 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:35.515796 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-42ea2c88-c414-43ad-9025-73212185fd22 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:35.651874 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-42ea2c88-c414-43ad-9025-73212185fd22 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:35.660437 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-42ea2c88-c414-43ad-9025-73212185fd22 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:35.664412 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-42ea2c88-c414-43ad-9025-73212185fd22 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:35.664412 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-42ea2c88-c414-43ad-9025-73212185fd22 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 200 len: 1670 microversion: 2.20 time: 0.163976 Aug 03 05:19:35.664412 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 427/822] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:19:35 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 1670 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:19:36.236027 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-158cd380-2315-43a5-9275-94d8e3fdb373 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:36.236667 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-158cd380-2315-43a5-9275-94d8e3fdb373 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:36.243258 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-158cd380-2315-43a5-9275-94d8e3fdb373 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:36.243728 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-158cd380-2315-43a5-9275-94d8e3fdb373 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:36.244497 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-158cd380-2315-43a5-9275-94d8e3fdb373 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:36.244934 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-158cd380-2315-43a5-9275-94d8e3fdb373 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:36.388584 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-ab5cee3b-2093-4cab-9a3e-8dafe298b135 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:36.390945 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-ab5cee3b-2093-4cab-9a3e-8dafe298b135 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: ddb3fb62-23ee-4e46-b198-e30b98687d24] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:36.393208 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-158cd380-2315-43a5-9275-94d8e3fdb373 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:36.397436 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ab5cee3b-2093-4cab-9a3e-8dafe298b135 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:36.403667 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ab5cee3b-2093-4cab-9a3e-8dafe298b135 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:36.403667 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ab5cee3b-2093-4cab-9a3e-8dafe298b135 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:36.403667 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ab5cee3b-2093-4cab-9a3e-8dafe298b135 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:36.403968 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-158cd380-2315-43a5-9275-94d8e3fdb373 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1575 microversion: 2.1 time: 0.169026 Aug 03 05:19:36.403968 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 396/823] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:36 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1575 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:36.578943 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-ab5cee3b-2093-4cab-9a3e-8dafe298b135 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.194773 Aug 03 05:19:36.579506 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 428/824] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Aug 3 05:19:36 2022] GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24/os-volume_attachments => generated 25 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 03 05:19:36.687435 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-c310c065-f2e4-4517-aba9-dbfa09187502 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:36.694871 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-c310c065-f2e4-4517-aba9-dbfa09187502 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:36.701167 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-409c36d2-a68a-47b2-baa7-f37524ff2b6e tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:36.703239 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-409c36d2-a68a-47b2-baa7-f37524ff2b6e tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: ddb3fb62-23ee-4e46-b198-e30b98687d24] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:36.706383 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-c310c065-f2e4-4517-aba9-dbfa09187502 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:36.707249 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-c310c065-f2e4-4517-aba9-dbfa09187502 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:36.708112 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-c310c065-f2e4-4517-aba9-dbfa09187502 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:36.709753 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-c310c065-f2e4-4517-aba9-dbfa09187502 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:36.710564 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-409c36d2-a68a-47b2-baa7-f37524ff2b6e tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:36.711061 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-409c36d2-a68a-47b2-baa7-f37524ff2b6e tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:36.711853 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-409c36d2-a68a-47b2-baa7-f37524ff2b6e tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:36.712300 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-409c36d2-a68a-47b2-baa7-f37524ff2b6e tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:36.712802 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=5,nova_cell1:UPDATE=5 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:19:36.717066 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:19:36.744228 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-409c36d2-a68a-47b2-baa7-f37524ff2b6e tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047812 Aug 03 05:19:36.745052 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 429/825] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Aug 3 05:19:36 2022] GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 03 05:19:36.811170 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-cc61604d-76ed-418f-9cdd-7630ca793b36 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:36.811673 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-cc61604d-76ed-418f-9cdd-7630ca793b36 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: ddb3fb62-23ee-4e46-b198-e30b98687d24] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:36.818674 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-cc61604d-76ed-418f-9cdd-7630ca793b36 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:36.819162 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-cc61604d-76ed-418f-9cdd-7630ca793b36 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:36.819939 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-cc61604d-76ed-418f-9cdd-7630ca793b36 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:36.820387 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-cc61604d-76ed-418f-9cdd-7630ca793b36 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:36.846383 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-cc61604d-76ed-418f-9cdd-7630ca793b36 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: ddb3fb62-23ee-4e46-b198-e30b98687d24] Going to try to terminate instance {{(pid=118331) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:19:37.043128 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-c310c065-f2e4-4517-aba9-dbfa09187502 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:37.051916 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-c310c065-f2e4-4517-aba9-dbfa09187502 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:37.053426 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-c310c065-f2e4-4517-aba9-dbfa09187502 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:37.054777 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-c310c065-f2e4-4517-aba9-dbfa09187502 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 200 len: 1728 microversion: 2.20 time: 0.371920 Aug 03 05:19:37.055364 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 397/826] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:19:36 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 1728 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:19:37.208487 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-cc61604d-76ed-418f-9cdd-7630ca793b36 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24" status: 204 len: 0 microversion: 2.1 time: 0.401501 Aug 03 05:19:37.209385 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 430/827] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Aug 3 05:19:36 2022] DELETE /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 05:19:37.218919 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-5750301c-1ab5-42ee-b042-48d8279da54f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:37.219567 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-5750301c-1ab5-42ee-b042-48d8279da54f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: ddb3fb62-23ee-4e46-b198-e30b98687d24] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:37.226604 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-5750301c-1ab5-42ee-b042-48d8279da54f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:37.227178 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-5750301c-1ab5-42ee-b042-48d8279da54f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:37.227959 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-5750301c-1ab5-42ee-b042-48d8279da54f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:37.228399 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-5750301c-1ab5-42ee-b042-48d8279da54f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:37.362058 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-5750301c-1ab5-42ee-b042-48d8279da54f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:37.369957 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-5750301c-1ab5-42ee-b042-48d8279da54f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24" status: 200 len: 1672 microversion: 2.1 time: 0.156123 Aug 03 05:19:37.375131 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 398/828] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:37 2022] GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24 => generated 1672 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:37.424614 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-8086c4a7-6f00-4258-93f6-40265630f942 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:37.425309 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-8086c4a7-6f00-4258-93f6-40265630f942 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:37.431329 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8086c4a7-6f00-4258-93f6-40265630f942 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:37.431788 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8086c4a7-6f00-4258-93f6-40265630f942 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:37.432555 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8086c4a7-6f00-4258-93f6-40265630f942 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:37.433027 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8086c4a7-6f00-4258-93f6-40265630f942 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:37.572993 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-8086c4a7-6f00-4258-93f6-40265630f942 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:37.581033 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-8086c4a7-6f00-4258-93f6-40265630f942 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1575 microversion: 2.1 time: 0.160917 Aug 03 05:19:37.581621 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 431/829] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:37 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:38.081219 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-a1f4bca3-b6a9-40a4-b1bb-3e40ccf65314 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:38.082107 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-a1f4bca3-b6a9-40a4-b1bb-3e40ccf65314 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:38.088143 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-a1f4bca3-b6a9-40a4-b1bb-3e40ccf65314 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:38.088601 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-a1f4bca3-b6a9-40a4-b1bb-3e40ccf65314 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:38.089890 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-a1f4bca3-b6a9-40a4-b1bb-3e40ccf65314 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:38.090338 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-a1f4bca3-b6a9-40a4-b1bb-3e40ccf65314 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:38.220753 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-a1f4bca3-b6a9-40a4-b1bb-3e40ccf65314 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:38.228721 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-a1f4bca3-b6a9-40a4-b1bb-3e40ccf65314 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:38.230320 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-a1f4bca3-b6a9-40a4-b1bb-3e40ccf65314 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:38.232184 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-a1f4bca3-b6a9-40a4-b1bb-3e40ccf65314 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 200 len: 1728 microversion: 2.20 time: 0.154937 Aug 03 05:19:38.232751 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 399/830] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:19:38 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:19:38.392173 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-b890d200-92fa-4976-a3fc-05ab8ce41b1c tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:38.392699 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-b890d200-92fa-4976-a3fc-05ab8ce41b1c tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: ddb3fb62-23ee-4e46-b198-e30b98687d24] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:38.398869 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b890d200-92fa-4976-a3fc-05ab8ce41b1c tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:38.399338 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b890d200-92fa-4976-a3fc-05ab8ce41b1c tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:38.400104 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b890d200-92fa-4976-a3fc-05ab8ce41b1c tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:38.400545 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b890d200-92fa-4976-a3fc-05ab8ce41b1c tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:38.533074 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-b890d200-92fa-4976-a3fc-05ab8ce41b1c tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:38.540552 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-b890d200-92fa-4976-a3fc-05ab8ce41b1c tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24" status: 200 len: 1672 microversion: 2.1 time: 0.152397 Aug 03 05:19:38.541116 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 432/831] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:38 2022] GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24 => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:38.604099 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-18ad463b-3cb6-46c8-bfd9-8848d9d751aa tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:38.604708 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-18ad463b-3cb6-46c8-bfd9-8848d9d751aa tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:38.611178 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-18ad463b-3cb6-46c8-bfd9-8848d9d751aa tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:38.611622 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-18ad463b-3cb6-46c8-bfd9-8848d9d751aa tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:38.612374 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-18ad463b-3cb6-46c8-bfd9-8848d9d751aa tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:38.612825 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-18ad463b-3cb6-46c8-bfd9-8848d9d751aa tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:38.743453 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-18ad463b-3cb6-46c8-bfd9-8848d9d751aa tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:38.751362 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-18ad463b-3cb6-46c8-bfd9-8848d9d751aa tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1575 microversion: 2.1 time: 0.151086 Aug 03 05:19:38.751927 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 400/832] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:38 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:39.255595 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-432bb8c2-8481-42b9-b11e-90c8a4a4a373 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:39.256201 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-432bb8c2-8481-42b9-b11e-90c8a4a4a373 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:39.262681 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-432bb8c2-8481-42b9-b11e-90c8a4a4a373 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:39.263161 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-432bb8c2-8481-42b9-b11e-90c8a4a4a373 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:39.263926 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-432bb8c2-8481-42b9-b11e-90c8a4a4a373 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:39.264368 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-432bb8c2-8481-42b9-b11e-90c8a4a4a373 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:39.394229 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-432bb8c2-8481-42b9-b11e-90c8a4a4a373 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:39.402538 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-432bb8c2-8481-42b9-b11e-90c8a4a4a373 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:39.404066 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-432bb8c2-8481-42b9-b11e-90c8a4a4a373 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:39.405735 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-432bb8c2-8481-42b9-b11e-90c8a4a4a373 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 200 len: 1728 microversion: 2.20 time: 0.154071 Aug 03 05:19:39.406274 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 433/833] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:19:39 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:19:39.561602 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-ed0b9737-e5ac-41c4-a6fc-13f886e149db tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:39.562137 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-ed0b9737-e5ac-41c4-a6fc-13f886e149db tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: ddb3fb62-23ee-4e46-b198-e30b98687d24] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:39.568244 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-ed0b9737-e5ac-41c4-a6fc-13f886e149db tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:39.568698 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-ed0b9737-e5ac-41c4-a6fc-13f886e149db tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:39.569459 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-ed0b9737-e5ac-41c4-a6fc-13f886e149db tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:39.569897 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-ed0b9737-e5ac-41c4-a6fc-13f886e149db tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:39.705438 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-ed0b9737-e5ac-41c4-a6fc-13f886e149db tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:39.713210 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-ed0b9737-e5ac-41c4-a6fc-13f886e149db tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24" status: 200 len: 1672 microversion: 2.1 time: 0.155535 Aug 03 05:19:39.713784 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 401/834] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:39 2022] GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24 => generated 1672 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:39.772905 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-c4d447ce-e872-471b-9e9c-101ac407d51e tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:39.773520 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-c4d447ce-e872-471b-9e9c-101ac407d51e tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:39.780176 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c4d447ce-e872-471b-9e9c-101ac407d51e tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:39.780636 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c4d447ce-e872-471b-9e9c-101ac407d51e tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:39.781407 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c4d447ce-e872-471b-9e9c-101ac407d51e tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:39.781846 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c4d447ce-e872-471b-9e9c-101ac407d51e tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:39.909704 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-c4d447ce-e872-471b-9e9c-101ac407d51e tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:39.917168 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-c4d447ce-e872-471b-9e9c-101ac407d51e tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1575 microversion: 2.1 time: 0.148067 Aug 03 05:19:39.917729 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 434/835] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:39 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1575 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:40.429169 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-d93f51d9-c92e-41aa-94ed-dbf3000c468f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:40.429782 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-d93f51d9-c92e-41aa-94ed-dbf3000c468f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:40.435860 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-d93f51d9-c92e-41aa-94ed-dbf3000c468f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:40.436322 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-d93f51d9-c92e-41aa-94ed-dbf3000c468f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:40.437087 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-d93f51d9-c92e-41aa-94ed-dbf3000c468f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:40.437525 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-d93f51d9-c92e-41aa-94ed-dbf3000c468f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:40.567969 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-d93f51d9-c92e-41aa-94ed-dbf3000c468f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:40.575950 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-d93f51d9-c92e-41aa-94ed-dbf3000c468f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:40.579566 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-d93f51d9-c92e-41aa-94ed-dbf3000c468f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:40.580785 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-d93f51d9-c92e-41aa-94ed-dbf3000c468f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 200 len: 1728 microversion: 2.20 time: 0.155338 Aug 03 05:19:40.582056 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 402/836] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:19:40 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:19:40.734647 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-f3bb3db1-4d9b-4a62-93d6-02280877ebc9 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:40.735280 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-f3bb3db1-4d9b-4a62-93d6-02280877ebc9 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: ddb3fb62-23ee-4e46-b198-e30b98687d24] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:40.741810 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f3bb3db1-4d9b-4a62-93d6-02280877ebc9 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:40.742252 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f3bb3db1-4d9b-4a62-93d6-02280877ebc9 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:40.743046 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f3bb3db1-4d9b-4a62-93d6-02280877ebc9 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:40.743484 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f3bb3db1-4d9b-4a62-93d6-02280877ebc9 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:40.924965 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-f3bb3db1-4d9b-4a62-93d6-02280877ebc9 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:40.932876 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-f3bb3db1-4d9b-4a62-93d6-02280877ebc9 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24" status: 200 len: 1672 microversion: 2.1 time: 0.201966 Aug 03 05:19:40.933457 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 435/837] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:40 2022] GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24 => generated 1672 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:40.938628 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-36a5752c-42d1-48e2-89d2-6ef6ff864634 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:40.939258 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-36a5752c-42d1-48e2-89d2-6ef6ff864634 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:40.945910 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-36a5752c-42d1-48e2-89d2-6ef6ff864634 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:40.953497 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-36a5752c-42d1-48e2-89d2-6ef6ff864634 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:40.953497 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-36a5752c-42d1-48e2-89d2-6ef6ff864634 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:40.953497 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-36a5752c-42d1-48e2-89d2-6ef6ff864634 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:41.079834 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-36a5752c-42d1-48e2-89d2-6ef6ff864634 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:41.087655 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-36a5752c-42d1-48e2-89d2-6ef6ff864634 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1575 microversion: 2.1 time: 0.153473 Aug 03 05:19:41.088227 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 403/838] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:40 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:41.604478 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-a9224c0f-63ef-4e87-b524-198405c3b13c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:41.605102 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-a9224c0f-63ef-4e87-b524-198405c3b13c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:41.611765 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a9224c0f-63ef-4e87-b524-198405c3b13c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:41.612218 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a9224c0f-63ef-4e87-b524-198405c3b13c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:41.612991 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a9224c0f-63ef-4e87-b524-198405c3b13c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:41.613427 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a9224c0f-63ef-4e87-b524-198405c3b13c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:41.854433 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-a9224c0f-63ef-4e87-b524-198405c3b13c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:41.864414 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-a9224c0f-63ef-4e87-b524-198405c3b13c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:41.866294 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-a9224c0f-63ef-4e87-b524-198405c3b13c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:41.874205 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-a9224c0f-63ef-4e87-b524-198405c3b13c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 200 len: 1728 microversion: 2.20 time: 0.267074 Aug 03 05:19:41.874205 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 436/839] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:19:41 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 1728 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:19:41.954914 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-bc29cd46-738c-4222-9a98-004e739cb294 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:41.955609 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-bc29cd46-738c-4222-9a98-004e739cb294 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: ddb3fb62-23ee-4e46-b198-e30b98687d24] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:41.964460 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-bc29cd46-738c-4222-9a98-004e739cb294 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:41.965265 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-bc29cd46-738c-4222-9a98-004e739cb294 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:41.966347 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-bc29cd46-738c-4222-9a98-004e739cb294 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:41.967611 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-bc29cd46-738c-4222-9a98-004e739cb294 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:42.116899 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-f9a62989-d445-4a77-9d0f-cd287f228b34 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:42.118063 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-f9a62989-d445-4a77-9d0f-cd287f228b34 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:42.125855 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f9a62989-d445-4a77-9d0f-cd287f228b34 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:42.126674 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f9a62989-d445-4a77-9d0f-cd287f228b34 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:42.127664 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f9a62989-d445-4a77-9d0f-cd287f228b34 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:42.128333 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f9a62989-d445-4a77-9d0f-cd287f228b34 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:42.313077 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-bc29cd46-738c-4222-9a98-004e739cb294 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:42.327125 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-bc29cd46-738c-4222-9a98-004e739cb294 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24" status: 200 len: 1672 microversion: 2.1 time: 0.376218 Aug 03 05:19:42.328329 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 404/840] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:41 2022] GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24 => generated 1672 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:42.441531 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-f9a62989-d445-4a77-9d0f-cd287f228b34 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:42.449448 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-f9a62989-d445-4a77-9d0f-cd287f228b34 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1575 microversion: 2.1 time: 0.344293 Aug 03 05:19:42.450031 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 437/841] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:42 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1575 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:42.891191 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-4c3d1958-9c44-4fc6-9a67-5958dc7bc911 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:42.891846 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-4c3d1958-9c44-4fc6-9a67-5958dc7bc911 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:42.898116 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-4c3d1958-9c44-4fc6-9a67-5958dc7bc911 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:42.898567 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-4c3d1958-9c44-4fc6-9a67-5958dc7bc911 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:42.899367 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-4c3d1958-9c44-4fc6-9a67-5958dc7bc911 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:42.899788 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-4c3d1958-9c44-4fc6-9a67-5958dc7bc911 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:43.064962 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-803c6ffe-f842-43d4-adde-3331ee96fe70 req-7d3e30ad-38c8-4dca-a214-c30c73932d76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddb3fb62-23ee-4e46-b198-e30b98687d24", "name": "network-vif-deleted", "tag": "295bab3a-078d-47dd-a131-28f87fd072a1"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:19:43.075669 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-803c6ffe-f842-43d4-adde-3331ee96fe70 req-7d3e30ad-38c8-4dca-a214-c30c73932d76 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:43.076642 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-803c6ffe-f842-43d4-adde-3331ee96fe70 req-7d3e30ad-38c8-4dca-a214-c30c73932d76 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:43.094625 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-803c6ffe-f842-43d4-adde-3331ee96fe70 req-7d3e30ad-38c8-4dca-a214-c30c73932d76 service nova] Creating event network-vif-deleted:295bab3a-078d-47dd-a131-28f87fd072a1 for instance ddb3fb62-23ee-4e46-b198-e30b98687d24 on hv-cinder-85127 Aug 03 05:19:43.116591 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-803c6ffe-f842-43d4-adde-3331ee96fe70 req-7d3e30ad-38c8-4dca-a214-c30c73932d76 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057585 Aug 03 05:19:43.118290 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 438/842] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:19:43.231380 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-4c3d1958-9c44-4fc6-9a67-5958dc7bc911 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:43.250259 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-4c3d1958-9c44-4fc6-9a67-5958dc7bc911 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:43.256832 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-4c3d1958-9c44-4fc6-9a67-5958dc7bc911 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:43.258647 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-4c3d1958-9c44-4fc6-9a67-5958dc7bc911 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 200 len: 1728 microversion: 2.20 time: 0.371478 Aug 03 05:19:43.264392 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 405/843] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:19:42 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 1728 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:19:43.354992 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-bffbb3dd-8d1e-4745-9560-107378195f0c tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:43.355995 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-bffbb3dd-8d1e-4745-9560-107378195f0c tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: ddb3fb62-23ee-4e46-b198-e30b98687d24] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:43.398016 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bffbb3dd-8d1e-4745-9560-107378195f0c tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:43.398016 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bffbb3dd-8d1e-4745-9560-107378195f0c tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:43.398016 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bffbb3dd-8d1e-4745-9560-107378195f0c tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:43.398016 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bffbb3dd-8d1e-4745-9560-107378195f0c tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:43.472639 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-78f580a9-630e-46e5-99a8-e33dd6a19ade tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:43.473255 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-78f580a9-630e-46e5-99a8-e33dd6a19ade tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:43.482160 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-bffbb3dd-8d1e-4745-9560-107378195f0c tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:43.483816 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-78f580a9-630e-46e5-99a8-e33dd6a19ade tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:43.484279 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-78f580a9-630e-46e5-99a8-e33dd6a19ade tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:43.485077 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-78f580a9-630e-46e5-99a8-e33dd6a19ade tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:43.485520 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-78f580a9-630e-46e5-99a8-e33dd6a19ade tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:43.491383 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-bffbb3dd-8d1e-4745-9560-107378195f0c tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24" status: 200 len: 1605 microversion: 2.1 time: 0.143005 Aug 03 05:19:43.491971 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 439/844] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:43 2022] GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24 => generated 1605 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:43.719139 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-78f580a9-630e-46e5-99a8-e33dd6a19ade tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:43.728631 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-78f580a9-630e-46e5-99a8-e33dd6a19ade tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1575 microversion: 2.1 time: 0.259654 Aug 03 05:19:43.730173 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 406/845] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:43 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1575 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:19:44.290163 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-f7dc2d73-41cf-4241-9648-7661b64d7afa tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:44.290777 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-f7dc2d73-41cf-4241-9648-7661b64d7afa tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:44.305074 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f7dc2d73-41cf-4241-9648-7661b64d7afa tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:44.305755 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f7dc2d73-41cf-4241-9648-7661b64d7afa tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:44.306804 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f7dc2d73-41cf-4241-9648-7661b64d7afa tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:44.307430 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f7dc2d73-41cf-4241-9648-7661b64d7afa tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:44.514882 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-7c8925e2-fae9-48bd-a313-b3df3238bdec tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:44.516088 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-7c8925e2-fae9-48bd-a313-b3df3238bdec tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: ddb3fb62-23ee-4e46-b198-e30b98687d24] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:44.528111 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-7c8925e2-fae9-48bd-a313-b3df3238bdec tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:44.528575 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-7c8925e2-fae9-48bd-a313-b3df3238bdec tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:44.531901 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-7c8925e2-fae9-48bd-a313-b3df3238bdec tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:44.532363 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-7c8925e2-fae9-48bd-a313-b3df3238bdec tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:44.573541 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-f7dc2d73-41cf-4241-9648-7661b64d7afa tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:44.590772 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-f7dc2d73-41cf-4241-9648-7661b64d7afa tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:44.592916 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-f7dc2d73-41cf-4241-9648-7661b64d7afa tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:44.594120 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-f7dc2d73-41cf-4241-9648-7661b64d7afa tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 200 len: 1728 microversion: 2.20 time: 0.308595 Aug 03 05:19:44.594689 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 440/846] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:19:44 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 1728 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 05:19:44.679181 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-7c8925e2-fae9-48bd-a313-b3df3238bdec tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:44.691120 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-7c8925e2-fae9-48bd-a313-b3df3238bdec tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24" status: 200 len: 1605 microversion: 2.1 time: 0.181031 Aug 03 05:19:44.704082 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 407/847] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:44 2022] GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24 => generated 1605 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:44.752402 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-a773d45a-5ff5-47f1-9f87-5ce249a51684 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:44.752990 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-a773d45a-5ff5-47f1-9f87-5ce249a51684 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:44.764130 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a773d45a-5ff5-47f1-9f87-5ce249a51684 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:44.764609 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a773d45a-5ff5-47f1-9f87-5ce249a51684 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:44.765403 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a773d45a-5ff5-47f1-9f87-5ce249a51684 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:44.765842 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a773d45a-5ff5-47f1-9f87-5ce249a51684 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:44.970667 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-a773d45a-5ff5-47f1-9f87-5ce249a51684 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:44.986131 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-a773d45a-5ff5-47f1-9f87-5ce249a51684 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1575 microversion: 2.1 time: 0.238213 Aug 03 05:19:44.987150 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 441/848] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:44 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1575 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:45.488214 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [req-d2a23896-b350-4438-8209-c602ba37e085 req-d16e74b0-80d6-47de-b48b-9187ece2b20d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0", "name": "network-vif-plugged", "status": "completed", "tag": "255ebc2e-922a-4b85-be40-f642cc2ae298"}]} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:19:45.503541 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-d2a23896-b350-4438-8209-c602ba37e085 req-d16e74b0-80d6-47de-b48b-9187ece2b20d service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:45.504187 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-d2a23896-b350-4438-8209-c602ba37e085 req-d16e74b0-80d6-47de-b48b-9187ece2b20d service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:45.526403 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.compute.server_external_events [req-d2a23896-b350-4438-8209-c602ba37e085 req-d16e74b0-80d6-47de-b48b-9187ece2b20d service nova] Creating event network-vif-plugged:255ebc2e-922a-4b85-be40-f642cc2ae298 for instance b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 on hv-cinder-85127 Aug 03 05:19:45.532685 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [req-d2a23896-b350-4438-8209-c602ba37e085 req-d16e74b0-80d6-47de-b48b-9187ece2b20d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049590 Aug 03 05:19:45.533311 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 408/849] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:19:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:19:45.618007 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-ac33212d-1a4f-4810-b2f9-afdb3a81c47c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:45.618629 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-ac33212d-1a4f-4810-b2f9-afdb3a81c47c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:45.625982 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ac33212d-1a4f-4810-b2f9-afdb3a81c47c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:45.627031 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ac33212d-1a4f-4810-b2f9-afdb3a81c47c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:45.627901 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ac33212d-1a4f-4810-b2f9-afdb3a81c47c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:45.628354 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ac33212d-1a4f-4810-b2f9-afdb3a81c47c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:45.717500 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-901047b1-c2e3-4c78-ba41-ceab9d473665 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:45.718220 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-901047b1-c2e3-4c78-ba41-ceab9d473665 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: ddb3fb62-23ee-4e46-b198-e30b98687d24] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:45.725225 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-901047b1-c2e3-4c78-ba41-ceab9d473665 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:45.725882 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-901047b1-c2e3-4c78-ba41-ceab9d473665 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:45.727179 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-901047b1-c2e3-4c78-ba41-ceab9d473665 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:45.727816 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-901047b1-c2e3-4c78-ba41-ceab9d473665 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:45.812187 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-901047b1-c2e3-4c78-ba41-ceab9d473665 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:45.815335 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-ac33212d-1a4f-4810-b2f9-afdb3a81c47c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:45.824358 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-ac33212d-1a4f-4810-b2f9-afdb3a81c47c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:45.825148 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-901047b1-c2e3-4c78-ba41-ceab9d473665 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24" status: 200 len: 1605 microversion: 2.1 time: 0.112725 Aug 03 05:19:45.828344 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 409/850] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:45 2022] GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24 => generated 1605 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:45.828496 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-ac33212d-1a4f-4810-b2f9-afdb3a81c47c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:45.828496 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-ac33212d-1a4f-4810-b2f9-afdb3a81c47c tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 200 len: 1728 microversion: 2.20 time: 0.213829 Aug 03 05:19:45.828496 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 442/851] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:19:45 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 1728 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:19:46.008818 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-822c8fac-1048-45d7-bc82-b33757bb5784 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:46.009539 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-822c8fac-1048-45d7-bc82-b33757bb5784 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:46.017215 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-822c8fac-1048-45d7-bc82-b33757bb5784 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:46.017965 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-822c8fac-1048-45d7-bc82-b33757bb5784 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:46.019048 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-822c8fac-1048-45d7-bc82-b33757bb5784 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:46.022754 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-822c8fac-1048-45d7-bc82-b33757bb5784 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:46.368339 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-822c8fac-1048-45d7-bc82-b33757bb5784 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:46.376229 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-822c8fac-1048-45d7-bc82-b33757bb5784 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1575 microversion: 2.1 time: 0.371402 Aug 03 05:19:46.377084 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 410/852] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:46 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1575 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:46.848341 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-cc8fc81e-31f4-431f-a45d-b26ceb1b9d8e tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:46.850043 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-cc8fc81e-31f4-431f-a45d-b26ceb1b9d8e tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: ddb3fb62-23ee-4e46-b198-e30b98687d24] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:46.851617 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-ceb16d18-4ed4-4494-be02-7e356a054606 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:46.852710 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-ceb16d18-4ed4-4494-be02-7e356a054606 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:46.858779 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-cc8fc81e-31f4-431f-a45d-b26ceb1b9d8e tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:46.862056 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-cc8fc81e-31f4-431f-a45d-b26ceb1b9d8e tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:46.863609 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-cc8fc81e-31f4-431f-a45d-b26ceb1b9d8e tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:46.864352 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-cc8fc81e-31f4-431f-a45d-b26ceb1b9d8e tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:46.865713 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-ceb16d18-4ed4-4494-be02-7e356a054606 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:46.870428 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-ceb16d18-4ed4-4494-be02-7e356a054606 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:46.871773 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-ceb16d18-4ed4-4494-be02-7e356a054606 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:46.872403 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-ceb16d18-4ed4-4494-be02-7e356a054606 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:46.958022 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-cc8fc81e-31f4-431f-a45d-b26ceb1b9d8e tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:46.966618 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-cc8fc81e-31f4-431f-a45d-b26ceb1b9d8e tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24" status: 200 len: 1605 microversion: 2.1 time: 0.122283 Aug 03 05:19:46.967498 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 443/853] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:46 2022] GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24 => generated 1605 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:19:47.112515 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-ceb16d18-4ed4-4494-be02-7e356a054606 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:47.121863 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-ceb16d18-4ed4-4494-be02-7e356a054606 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:47.124219 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-ceb16d18-4ed4-4494-be02-7e356a054606 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:47.125670 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-ceb16d18-4ed4-4494-be02-7e356a054606 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 200 len: 1728 microversion: 2.20 time: 0.278073 Aug 03 05:19:47.126890 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 411/854] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:19:46 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 1728 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 05:19:47.397820 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-bea948d8-cfbd-40cc-9566-6f2d03f99738 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:47.398436 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-bea948d8-cfbd-40cc-9566-6f2d03f99738 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:47.415482 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bea948d8-cfbd-40cc-9566-6f2d03f99738 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:47.415943 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bea948d8-cfbd-40cc-9566-6f2d03f99738 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:47.416743 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bea948d8-cfbd-40cc-9566-6f2d03f99738 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:47.417188 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bea948d8-cfbd-40cc-9566-6f2d03f99738 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:47.637464 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-bea948d8-cfbd-40cc-9566-6f2d03f99738 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:47.649715 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:19:47.654116 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-bea948d8-cfbd-40cc-9566-6f2d03f99738 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1575 microversion: 2.1 time: 0.258665 Aug 03 05:19:47.654116 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 444/855] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:47 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1575 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:47.988895 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-de5d6a1c-e567-44cb-bb08-0f710321620e tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:47.989432 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-de5d6a1c-e567-44cb-bb08-0f710321620e tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: ddb3fb62-23ee-4e46-b198-e30b98687d24] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:47.996136 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-de5d6a1c-e567-44cb-bb08-0f710321620e tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:47.996583 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-de5d6a1c-e567-44cb-bb08-0f710321620e tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:47.997349 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-de5d6a1c-e567-44cb-bb08-0f710321620e tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:47.998294 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-de5d6a1c-e567-44cb-bb08-0f710321620e tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:48.099157 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-de5d6a1c-e567-44cb-bb08-0f710321620e tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:48.117727 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-de5d6a1c-e567-44cb-bb08-0f710321620e tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24" status: 200 len: 1605 microversion: 2.1 time: 0.132640 Aug 03 05:19:48.118943 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 412/856] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:47 2022] GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24 => generated 1605 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:19:48.151885 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-48e5c63c-e61d-4eac-8b52-c8efda5722aa tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:48.152501 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-48e5c63c-e61d-4eac-8b52-c8efda5722aa tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:48.160759 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-48e5c63c-e61d-4eac-8b52-c8efda5722aa tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:48.161218 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-48e5c63c-e61d-4eac-8b52-c8efda5722aa tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:48.162018 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-48e5c63c-e61d-4eac-8b52-c8efda5722aa tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:48.162464 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-48e5c63c-e61d-4eac-8b52-c8efda5722aa tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:48.314086 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-48e5c63c-e61d-4eac-8b52-c8efda5722aa tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:48.322659 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-48e5c63c-e61d-4eac-8b52-c8efda5722aa tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:48.324491 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-48e5c63c-e61d-4eac-8b52-c8efda5722aa tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:48.325759 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-48e5c63c-e61d-4eac-8b52-c8efda5722aa tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 200 len: 1728 microversion: 2.20 time: 0.178175 Aug 03 05:19:48.329242 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 445/857] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:19:48 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 1728 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:19:48.676600 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-6ba2bd99-3d83-4652-be43-ac7e4421f99f tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:48.677554 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-6ba2bd99-3d83-4652-be43-ac7e4421f99f tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:48.684539 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-6ba2bd99-3d83-4652-be43-ac7e4421f99f tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:48.684993 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-6ba2bd99-3d83-4652-be43-ac7e4421f99f tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:48.685777 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-6ba2bd99-3d83-4652-be43-ac7e4421f99f tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:48.686216 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-6ba2bd99-3d83-4652-be43-ac7e4421f99f tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:48.862358 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-6ba2bd99-3d83-4652-be43-ac7e4421f99f tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:48.872124 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-6ba2bd99-3d83-4652-be43-ac7e4421f99f tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1575 microversion: 2.1 time: 0.199535 Aug 03 05:19:48.872725 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 413/858] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:48 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1575 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:49.141001 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-dd9a4710-b2c7-4560-ad83-b6a9687cbc54 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:49.141617 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-dd9a4710-b2c7-4560-ad83-b6a9687cbc54 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: ddb3fb62-23ee-4e46-b198-e30b98687d24] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:49.149198 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-dd9a4710-b2c7-4560-ad83-b6a9687cbc54 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:49.149656 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-dd9a4710-b2c7-4560-ad83-b6a9687cbc54 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:49.150596 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-dd9a4710-b2c7-4560-ad83-b6a9687cbc54 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:49.151105 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-dd9a4710-b2c7-4560-ad83-b6a9687cbc54 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:49.234567 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-dd9a4710-b2c7-4560-ad83-b6a9687cbc54 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:49.242826 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-dd9a4710-b2c7-4560-ad83-b6a9687cbc54 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24" status: 200 len: 1605 microversion: 2.1 time: 0.106526 Aug 03 05:19:49.243877 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 446/859] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:49 2022] GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24 => generated 1605 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:49.351419 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-08e71a15-2157-4ae9-a718-893898f9e256 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:49.354496 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-08e71a15-2157-4ae9-a718-893898f9e256 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:49.363969 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-08e71a15-2157-4ae9-a718-893898f9e256 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:49.364882 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-08e71a15-2157-4ae9-a718-893898f9e256 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:49.365804 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-08e71a15-2157-4ae9-a718-893898f9e256 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:49.366384 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-08e71a15-2157-4ae9-a718-893898f9e256 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:49.391764 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_cell1:SELECT=100 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:19:49.518318 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-08e71a15-2157-4ae9-a718-893898f9e256 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:49.533465 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-08e71a15-2157-4ae9-a718-893898f9e256 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:49.545565 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-08e71a15-2157-4ae9-a718-893898f9e256 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:49.546869 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-08e71a15-2157-4ae9-a718-893898f9e256 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 200 len: 1728 microversion: 2.20 time: 0.201461 Aug 03 05:19:49.629621 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 414/860] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:19:49 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 1728 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 05:19:49.894700 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-e37be3a7-7813-49d6-97e9-591dfb19f4bf tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:49.895825 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-e37be3a7-7813-49d6-97e9-591dfb19f4bf tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:49.902170 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e37be3a7-7813-49d6-97e9-591dfb19f4bf tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:49.902626 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e37be3a7-7813-49d6-97e9-591dfb19f4bf tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:49.903438 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e37be3a7-7813-49d6-97e9-591dfb19f4bf tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:49.903889 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e37be3a7-7813-49d6-97e9-591dfb19f4bf tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:50.048231 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-e37be3a7-7813-49d6-97e9-591dfb19f4bf tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:50.059327 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-e37be3a7-7813-49d6-97e9-591dfb19f4bf tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1575 microversion: 2.1 time: 0.169495 Aug 03 05:19:50.060052 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 447/861] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:49 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:50.266065 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-5f3dc884-1fd6-43af-b409-ea472daddb01 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:50.266679 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-5f3dc884-1fd6-43af-b409-ea472daddb01 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: ddb3fb62-23ee-4e46-b198-e30b98687d24] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:50.276533 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-5f3dc884-1fd6-43af-b409-ea472daddb01 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:50.276533 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-5f3dc884-1fd6-43af-b409-ea472daddb01 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:50.276533 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-5f3dc884-1fd6-43af-b409-ea472daddb01 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:50.284423 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-5f3dc884-1fd6-43af-b409-ea472daddb01 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:50.344831 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-5f3dc884-1fd6-43af-b409-ea472daddb01 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:50.352431 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-5f3dc884-1fd6-43af-b409-ea472daddb01 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24" status: 200 len: 1322 microversion: 2.1 time: 0.091058 Aug 03 05:19:50.353712 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 415/862] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:50 2022] GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24 => generated 1322 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:50.657847 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-46b201c6-0605-4ab1-8fca-3c4a6b98358a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:50.658474 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-46b201c6-0605-4ab1-8fca-3c4a6b98358a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:50.667599 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-46b201c6-0605-4ab1-8fca-3c4a6b98358a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:50.668060 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-46b201c6-0605-4ab1-8fca-3c4a6b98358a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:50.668849 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-46b201c6-0605-4ab1-8fca-3c4a6b98358a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:50.669293 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-46b201c6-0605-4ab1-8fca-3c4a6b98358a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:50.810055 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-46b201c6-0605-4ab1-8fca-3c4a6b98358a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:50.818793 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-46b201c6-0605-4ab1-8fca-3c4a6b98358a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:50.820374 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-46b201c6-0605-4ab1-8fca-3c4a6b98358a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:50.821548 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-46b201c6-0605-4ab1-8fca-3c4a6b98358a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 200 len: 1728 microversion: 2.20 time: 0.167854 Aug 03 05:19:50.822101 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 448/863] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:19:50 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 1728 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:19:51.079906 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-782fecb9-929e-4cbd-a135-9ef46d1e0149 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:51.080512 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-782fecb9-929e-4cbd-a135-9ef46d1e0149 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:51.087521 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-782fecb9-929e-4cbd-a135-9ef46d1e0149 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:51.087968 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-782fecb9-929e-4cbd-a135-9ef46d1e0149 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:51.088729 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-782fecb9-929e-4cbd-a135-9ef46d1e0149 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:51.089171 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-782fecb9-929e-4cbd-a135-9ef46d1e0149 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:51.254456 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-782fecb9-929e-4cbd-a135-9ef46d1e0149 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:51.262246 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-782fecb9-929e-4cbd-a135-9ef46d1e0149 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1575 microversion: 2.1 time: 0.186177 Aug 03 05:19:51.262815 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 416/864] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:51 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1575 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:51.374336 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-df9e359c-98ad-4821-a54d-6cfee28df1ec tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:51.380632 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-df9e359c-98ad-4821-a54d-6cfee28df1ec tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: ddb3fb62-23ee-4e46-b198-e30b98687d24] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:51.383423 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-df9e359c-98ad-4821-a54d-6cfee28df1ec tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:51.384058 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-df9e359c-98ad-4821-a54d-6cfee28df1ec tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:51.384854 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-df9e359c-98ad-4821-a54d-6cfee28df1ec tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:51.385310 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-df9e359c-98ad-4821-a54d-6cfee28df1ec tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:51.432842 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-df9e359c-98ad-4821-a54d-6cfee28df1ec tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:51.433947 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-df9e359c-98ad-4821-a54d-6cfee28df1ec tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:51.434783 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.objects.instance [None req-df9e359c-98ad-4821-a54d-6cfee28df1ec tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lazy-loading 'fault' on Instance uuid ddb3fb62-23ee-4e46-b198-e30b98687d24 {{(pid=118331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:19:51.493996 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-df9e359c-98ad-4821-a54d-6cfee28df1ec tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01737ba3200470c8635f335d0338ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ed25abd8e43009dd8f3f4b7ec1864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:51.501800 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-df9e359c-98ad-4821-a54d-6cfee28df1ec tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24" status: 200 len: 1327 microversion: 2.1 time: 0.133035 Aug 03 05:19:51.502397 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 449/865] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:51 2022] GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24 => generated 1327 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:51.846043 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-92caf8dd-5b89-4a38-bb05-4ef1fc19896a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:51.846650 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-92caf8dd-5b89-4a38-bb05-4ef1fc19896a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:51.853009 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-92caf8dd-5b89-4a38-bb05-4ef1fc19896a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:51.853483 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-92caf8dd-5b89-4a38-bb05-4ef1fc19896a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:51.855131 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-92caf8dd-5b89-4a38-bb05-4ef1fc19896a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:51.855580 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-92caf8dd-5b89-4a38-bb05-4ef1fc19896a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:52.011473 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-92caf8dd-5b89-4a38-bb05-4ef1fc19896a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:52.020159 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-92caf8dd-5b89-4a38-bb05-4ef1fc19896a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:52.021877 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-92caf8dd-5b89-4a38-bb05-4ef1fc19896a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:52.023074 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-92caf8dd-5b89-4a38-bb05-4ef1fc19896a tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 200 len: 1728 microversion: 2.20 time: 0.181654 Aug 03 05:19:52.023690 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 417/866] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:19:51 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 1728 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:19:52.283460 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-9dd8c389-c6bf-470f-8523-008d9bea124a tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:52.284176 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-9dd8c389-c6bf-470f-8523-008d9bea124a tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:52.291319 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9dd8c389-c6bf-470f-8523-008d9bea124a tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:52.291777 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9dd8c389-c6bf-470f-8523-008d9bea124a tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:52.292597 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9dd8c389-c6bf-470f-8523-008d9bea124a tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:52.293046 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9dd8c389-c6bf-470f-8523-008d9bea124a tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:52.429470 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-9dd8c389-c6bf-470f-8523-008d9bea124a tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:52.437855 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-9dd8c389-c6bf-470f-8523-008d9bea124a tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1575 microversion: 2.1 time: 0.158315 Aug 03 05:19:52.438427 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 450/867] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:52 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:52.523392 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-02b9c8e9-13a6-4899-8825-e5b5d0b069ed tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:52.524085 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-02b9c8e9-13a6-4899-8825-e5b5d0b069ed tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: ddb3fb62-23ee-4e46-b198-e30b98687d24] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:52.530786 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-02b9c8e9-13a6-4899-8825-e5b5d0b069ed tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:52.533771 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-02b9c8e9-13a6-4899-8825-e5b5d0b069ed tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:52.533771 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-02b9c8e9-13a6-4899-8825-e5b5d0b069ed tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:52.533771 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-02b9c8e9-13a6-4899-8825-e5b5d0b069ed tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:52.547078 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.wsgi [None req-02b9c8e9-13a6-4899-8825-e5b5d0b069ed tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] HTTP exception thrown: Instance ddb3fb62-23ee-4e46-b198-e30b98687d24 could not be found. Aug 03 05:19:52.549415 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-02b9c8e9-13a6-4899-8825-e5b5d0b069ed tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Request method failure captured: Aug 03 05:19:52.549415 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: request: GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24 HTTP/1.1 Aug 03 05:19:52.549415 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Accept: application/json Aug 03 05:19:52.549415 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Accept-Encoding: identity Aug 03 05:19:52.549415 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Connection: close Aug 03 05:19:52.549415 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Content-Length: 0 Aug 03 05:19:52.549415 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Content-Type: application/json Aug 03 05:19:52.549415 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Host: 10.222.0.40 Aug 03 05:19:52.549415 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Openstack-System-Scope: None Aug 03 05:19:52.549415 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: User-Agent: python-urllib3/1.26.10 Aug 03 05:19:52.549415 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Auth-Token: gAAAAABi6gPfEYWmbBjRTCK0CUzBUvoIT1d12R6hM-5W5QKad94EcPrIuWEjzTWcdaoDev20Cjg5zI_jw18KOj7aoqrve4p1CjNeo82L37J1_7mc-_oPeqPMuwknK_3IKe4uqnCHfGy1Z4Z_S5S6r9xstkEas5zsjC0rxYdGYTaNfxf5rdAx4U0 Aug 03 05:19:52.549415 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Domain-Id: None Aug 03 05:19:52.549415 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Domain-Name: None Aug 03 05:19:52.549415 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Identity-Status: Confirmed Aug 03 05:19:52.549415 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Is-Admin-Project: True Aug 03 05:19:52.549415 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Domain-Id: default Aug 03 05:19:52.549415 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Domain-Name: Default Aug 03 05:19:52.549415 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Id: 2e1ed25abd8e43009dd8f3f4b7ec1864 Aug 03 05:19:52.549415 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Name: tempest-AttachVolumeTestJSON-331802604 Aug 03 05:19:52.549415 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Role: member,reader Aug 03 05:19:52.549415 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Roles: member,reader Aug 03 05:19:52.556879 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2e1ed25abd8e43009dd8f3f4b7ec1864"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2e1ed25abd8e43009dd8f3f4b7ec1864"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2e1ed25abd8e43009dd8f3f4b7ec1864"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2e1ed25abd8e43009dd8f3f4b7ec1864"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:19:52.556879 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant: tempest-AttachVolumeTestJSON-331802604 Aug 03 05:19:52.556879 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant-Id: 2e1ed25abd8e43009dd8f3f4b7ec1864 Aug 03 05:19:52.556879 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant-Name: tempest-AttachVolumeTestJSON-331802604 Aug 03 05:19:52.556879 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User: tempest-AttachVolumeTestJSON-331802604-project Aug 03 05:19:52.556879 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Domain-Id: default Aug 03 05:19:52.556879 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Domain-Name: Default Aug 03 05:19:52.556879 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Id: f01737ba3200470c8635f335d0338ac8 Aug 03 05:19:52.556879 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Name: tempest-AttachVolumeTestJSON-331802604-project Aug 03 05:19:52.556879 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: method: > Aug 03 05:19:52.556879 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: exception: Instance ddb3fb62-23ee-4e46-b198-e30b98687d24 could not be found. Aug 03 05:19:52.556879 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: action_args: {'id': 'ddb3fb62-23ee-4e46-b198-e30b98687d24'} Aug 03 05:19:52.557734 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:19:52.557734 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:19:52.557734 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:19:52.557734 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:19:52.557734 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:19:52.557734 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:19:52.557734 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:19:52.557734 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:19:52.557734 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:19:52.557734 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:19:52.557734 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddb3fb62-23ee-4e46-b198-e30b98687d24 could not be found. Aug 03 05:19:52.557734 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:19:52.557734 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:19:52.557734 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:19:52.557734 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:19:52.557734 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:19:52.557734 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:19:52.557734 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:19:52.557734 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:19:52.557734 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:19:52.559064 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:19:52.559064 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:19:52.559064 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:19:52.559064 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:19:52.559064 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:19:52.559064 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:19:52.559064 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:19:52.559064 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddb3fb62-23ee-4e46-b198-e30b98687d24 could not be found. Aug 03 05:19:52.559064 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:19:52.559064 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:19:52.559064 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:19:52.559064 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:19:52.559064 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:19:52.559064 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:19:52.559064 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:19:52.559064 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:19:52.559064 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddb3fb62-23ee-4e46-b198-e30b98687d24 could not be found. Aug 03 05:19:52.559064 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:19:52.560231 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-02b9c8e9-13a6-4899-8825-e5b5d0b069ed tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Returning 404 to user: Instance ddb3fb62-23ee-4e46-b198-e30b98687d24 could not be found. {{(pid=118332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:19:52.560231 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-02b9c8e9-13a6-4899-8825-e5b5d0b069ed tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24" status: 404 len: 111 microversion: 2.1 time: 0.031296 Aug 03 05:19:52.560231 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 418/868] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:52 2022] GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:19:52.560455 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-7f730749-6d4f-4bff-8728-7a83de971f73 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '.version_select at 0x7f7601e4fee0>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:52.672060 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-7f730749-6d4f-4bff-8728-7a83de971f73 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-927766371" status: 202 len: 0 microversion: 2.1 time: 0.116034 Aug 03 05:19:52.672613 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 451/869] 10.222.0.40 () {58 vars in 1218 bytes} [Wed Aug 3 05:19:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-927766371 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:19:53.046516 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-e2a3c93f-865b-4a25-b023-d56a02ea69c2 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:53.047228 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-e2a3c93f-865b-4a25-b023-d56a02ea69c2 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:53.053723 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e2a3c93f-865b-4a25-b023-d56a02ea69c2 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:53.054259 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e2a3c93f-865b-4a25-b023-d56a02ea69c2 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:53.055126 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e2a3c93f-865b-4a25-b023-d56a02ea69c2 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:53.055626 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e2a3c93f-865b-4a25-b023-d56a02ea69c2 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:53.261584 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-e2a3c93f-865b-4a25-b023-d56a02ea69c2 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:53.269854 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-e2a3c93f-865b-4a25-b023-d56a02ea69c2 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:53.271384 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-e2a3c93f-865b-4a25-b023-d56a02ea69c2 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:53.272579 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-e2a3c93f-865b-4a25-b023-d56a02ea69c2 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 200 len: 1728 microversion: 2.20 time: 0.230130 Aug 03 05:19:53.273184 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 419/870] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:19:53 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 1728 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:19:53.461717 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-546754db-1571-4d8d-a724-6b7bf0a80ab0 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:53.463439 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-546754db-1571-4d8d-a724-6b7bf0a80ab0 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:53.471919 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-546754db-1571-4d8d-a724-6b7bf0a80ab0 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:53.472626 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-546754db-1571-4d8d-a724-6b7bf0a80ab0 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:53.474271 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-546754db-1571-4d8d-a724-6b7bf0a80ab0 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:53.474946 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-546754db-1571-4d8d-a724-6b7bf0a80ab0 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:53.522685 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [req-9abda100-6c79-4803-8cb1-93cd6d4792ce req-780d89fa-658e-42da-9c88-008812eff380 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67b3164b-4fb1-4812-94b7-cc60b3040700", "name": "network-vif-plugged", "status": "completed", "tag": "ac9d083a-77d7-4d9d-a0ea-ee7b9f6e3aab"}]} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:19:53.535849 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-9abda100-6c79-4803-8cb1-93cd6d4792ce req-780d89fa-658e-42da-9c88-008812eff380 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:53.536295 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-9abda100-6c79-4803-8cb1-93cd6d4792ce req-780d89fa-658e-42da-9c88-008812eff380 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:53.549392 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.compute.server_external_events [req-9abda100-6c79-4803-8cb1-93cd6d4792ce req-780d89fa-658e-42da-9c88-008812eff380 service nova] Creating event network-vif-plugged:ac9d083a-77d7-4d9d-a0ea-ee7b9f6e3aab for instance 67b3164b-4fb1-4812-94b7-cc60b3040700 on hv-cinder-85127 Aug 03 05:19:53.554813 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [req-9abda100-6c79-4803-8cb1-93cd6d4792ce req-780d89fa-658e-42da-9c88-008812eff380 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036246 Aug 03 05:19:53.555969 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 420/871] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:19:53.643372 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-546754db-1571-4d8d-a724-6b7bf0a80ab0 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:53.651441 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-546754db-1571-4d8d-a724-6b7bf0a80ab0 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1562 microversion: 2.1 time: 0.194124 Aug 03 05:19:53.652010 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 452/872] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:53 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1562 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:54.296714 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-e612c488-8e54-490a-975a-49d8d0137974 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:54.297445 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-e612c488-8e54-490a-975a-49d8d0137974 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:54.303974 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e612c488-8e54-490a-975a-49d8d0137974 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:54.304428 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e612c488-8e54-490a-975a-49d8d0137974 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:54.305397 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e612c488-8e54-490a-975a-49d8d0137974 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:54.305793 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e612c488-8e54-490a-975a-49d8d0137974 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:54.440528 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-e612c488-8e54-490a-975a-49d8d0137974 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:54.448838 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-e612c488-8e54-490a-975a-49d8d0137974 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:54.450373 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-e612c488-8e54-490a-975a-49d8d0137974 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:54.451598 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-e612c488-8e54-490a-975a-49d8d0137974 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 200 len: 1728 microversion: 2.20 time: 0.159686 Aug 03 05:19:54.452215 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 421/873] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:19:54 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:19:55.476829 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-332068b8-5b67-45d3-a4ef-143d02bebb07 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:55.477442 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-332068b8-5b67-45d3-a4ef-143d02bebb07 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:55.484579 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-332068b8-5b67-45d3-a4ef-143d02bebb07 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:55.485044 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-332068b8-5b67-45d3-a4ef-143d02bebb07 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:55.485827 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-332068b8-5b67-45d3-a4ef-143d02bebb07 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:55.486407 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-332068b8-5b67-45d3-a4ef-143d02bebb07 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:55.619576 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-332068b8-5b67-45d3-a4ef-143d02bebb07 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:55.628933 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-332068b8-5b67-45d3-a4ef-143d02bebb07 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:55.631112 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-332068b8-5b67-45d3-a4ef-143d02bebb07 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:55.632815 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-332068b8-5b67-45d3-a4ef-143d02bebb07 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 200 len: 1728 microversion: 2.20 time: 0.160048 Aug 03 05:19:55.636630 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 453/874] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:19:55 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:19:56.657149 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-25188421-bc18-4d89-8447-3a874ff3ea06 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:56.657756 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-25188421-bc18-4d89-8447-3a874ff3ea06 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:56.665737 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-25188421-bc18-4d89-8447-3a874ff3ea06 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:56.666627 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-25188421-bc18-4d89-8447-3a874ff3ea06 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:56.668339 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-25188421-bc18-4d89-8447-3a874ff3ea06 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:56.668339 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-25188421-bc18-4d89-8447-3a874ff3ea06 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:56.718964 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-0038e099-ffc9-421a-aef2-2dfba0b5302d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:56.719516 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-0038e099-ffc9-421a-aef2-2dfba0b5302d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: ddb3fb62-23ee-4e46-b198-e30b98687d24] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:56.726374 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0038e099-ffc9-421a-aef2-2dfba0b5302d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:56.726834 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0038e099-ffc9-421a-aef2-2dfba0b5302d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:56.727679 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0038e099-ffc9-421a-aef2-2dfba0b5302d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:56.728431 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0038e099-ffc9-421a-aef2-2dfba0b5302d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:56.742940 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.wsgi [None req-0038e099-ffc9-421a-aef2-2dfba0b5302d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] HTTP exception thrown: Instance ddb3fb62-23ee-4e46-b198-e30b98687d24 could not be found. Aug 03 05:19:56.744660 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-0038e099-ffc9-421a-aef2-2dfba0b5302d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Request method failure captured: Aug 03 05:19:56.744660 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: request: DELETE /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24 HTTP/1.1 Aug 03 05:19:56.744660 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Accept: application/json Aug 03 05:19:56.744660 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Accept-Encoding: identity Aug 03 05:19:56.744660 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Connection: close Aug 03 05:19:56.744660 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Content-Length: 0 Aug 03 05:19:56.744660 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Content-Type: application/json Aug 03 05:19:56.744660 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Host: 10.222.0.40 Aug 03 05:19:56.744660 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Openstack-System-Scope: None Aug 03 05:19:56.744660 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: User-Agent: python-urllib3/1.26.10 Aug 03 05:19:56.744660 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Auth-Token: gAAAAABi6gPfEYWmbBjRTCK0CUzBUvoIT1d12R6hM-5W5QKad94EcPrIuWEjzTWcdaoDev20Cjg5zI_jw18KOj7aoqrve4p1CjNeo82L37J1_7mc-_oPeqPMuwknK_3IKe4uqnCHfGy1Z4Z_S5S6r9xstkEas5zsjC0rxYdGYTaNfxf5rdAx4U0 Aug 03 05:19:56.744660 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Domain-Id: None Aug 03 05:19:56.744660 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Domain-Name: None Aug 03 05:19:56.744660 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Identity-Status: Confirmed Aug 03 05:19:56.744660 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Is-Admin-Project: True Aug 03 05:19:56.744660 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Domain-Id: default Aug 03 05:19:56.744660 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Domain-Name: Default Aug 03 05:19:56.744660 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Id: 2e1ed25abd8e43009dd8f3f4b7ec1864 Aug 03 05:19:56.744660 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Name: tempest-AttachVolumeTestJSON-331802604 Aug 03 05:19:56.744660 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Role: member,reader Aug 03 05:19:56.744660 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Roles: member,reader Aug 03 05:19:56.746225 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2e1ed25abd8e43009dd8f3f4b7ec1864"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2e1ed25abd8e43009dd8f3f4b7ec1864"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2e1ed25abd8e43009dd8f3f4b7ec1864"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2e1ed25abd8e43009dd8f3f4b7ec1864"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:19:56.746225 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant: tempest-AttachVolumeTestJSON-331802604 Aug 03 05:19:56.746225 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant-Id: 2e1ed25abd8e43009dd8f3f4b7ec1864 Aug 03 05:19:56.746225 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant-Name: tempest-AttachVolumeTestJSON-331802604 Aug 03 05:19:56.746225 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User: tempest-AttachVolumeTestJSON-331802604-project Aug 03 05:19:56.746225 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Domain-Id: default Aug 03 05:19:56.746225 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Domain-Name: Default Aug 03 05:19:56.746225 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Id: f01737ba3200470c8635f335d0338ac8 Aug 03 05:19:56.746225 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Name: tempest-AttachVolumeTestJSON-331802604-project Aug 03 05:19:56.746225 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: method: > Aug 03 05:19:56.746225 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: exception: Instance ddb3fb62-23ee-4e46-b198-e30b98687d24 could not be found. Aug 03 05:19:56.746225 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: action_args: {'id': 'ddb3fb62-23ee-4e46-b198-e30b98687d24'} Aug 03 05:19:56.747073 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:19:56.747073 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:19:56.747073 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:19:56.747073 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:19:56.747073 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:19:56.747073 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:19:56.747073 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:19:56.747073 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:19:56.747073 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:19:56.747073 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:19:56.747073 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddb3fb62-23ee-4e46-b198-e30b98687d24 could not be found. Aug 03 05:19:56.747073 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:19:56.747073 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:19:56.747073 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:19:56.747073 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:19:56.747073 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:19:56.747073 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:19:56.747073 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:19:56.747073 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:19:56.747073 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:19:56.748371 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:19:56.748371 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 05:19:56.748371 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 05:19:56.748371 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 05:19:56.748371 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 05:19:56.748371 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:19:56.748371 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:19:56.748371 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:19:56.748371 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:19:56.748371 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddb3fb62-23ee-4e46-b198-e30b98687d24 could not be found. Aug 03 05:19:56.748371 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:19:56.748371 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:19:56.748371 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:19:56.748371 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:19:56.748371 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:19:56.748371 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:19:56.748371 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:19:56.748371 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:19:56.748371 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddb3fb62-23ee-4e46-b198-e30b98687d24 could not be found. Aug 03 05:19:56.748371 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:19:56.749547 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-0038e099-ffc9-421a-aef2-2dfba0b5302d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Returning 404 to user: Instance ddb3fb62-23ee-4e46-b198-e30b98687d24 could not be found. {{(pid=118331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:19:56.749547 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-0038e099-ffc9-421a-aef2-2dfba0b5302d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24" status: 404 len: 111 microversion: 2.1 time: 0.031618 Aug 03 05:19:56.749547 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 454/875] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Aug 3 05:19:56 2022] DELETE /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 05:19:56.757030 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-f5fc5100-d0f8-4296-9865-bfcddd66c67f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:56.757679 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-f5fc5100-d0f8-4296-9865-bfcddd66c67f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: ddb3fb62-23ee-4e46-b198-e30b98687d24] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:56.763829 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f5fc5100-d0f8-4296-9865-bfcddd66c67f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:56.766902 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f5fc5100-d0f8-4296-9865-bfcddd66c67f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:56.766902 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f5fc5100-d0f8-4296-9865-bfcddd66c67f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:56.766902 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f5fc5100-d0f8-4296-9865-bfcddd66c67f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:56.779068 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.wsgi [None req-f5fc5100-d0f8-4296-9865-bfcddd66c67f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] HTTP exception thrown: Instance ddb3fb62-23ee-4e46-b198-e30b98687d24 could not be found. Aug 03 05:19:56.781286 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-f5fc5100-d0f8-4296-9865-bfcddd66c67f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Request method failure captured: Aug 03 05:19:56.781286 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: request: GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24 HTTP/1.1 Aug 03 05:19:56.781286 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Accept: application/json Aug 03 05:19:56.781286 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Accept-Encoding: identity Aug 03 05:19:56.781286 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Connection: close Aug 03 05:19:56.781286 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Content-Length: 0 Aug 03 05:19:56.781286 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Content-Type: application/json Aug 03 05:19:56.781286 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Host: 10.222.0.40 Aug 03 05:19:56.781286 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Openstack-System-Scope: None Aug 03 05:19:56.781286 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: User-Agent: python-urllib3/1.26.10 Aug 03 05:19:56.781286 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Auth-Token: gAAAAABi6gPfEYWmbBjRTCK0CUzBUvoIT1d12R6hM-5W5QKad94EcPrIuWEjzTWcdaoDev20Cjg5zI_jw18KOj7aoqrve4p1CjNeo82L37J1_7mc-_oPeqPMuwknK_3IKe4uqnCHfGy1Z4Z_S5S6r9xstkEas5zsjC0rxYdGYTaNfxf5rdAx4U0 Aug 03 05:19:56.781286 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Domain-Id: None Aug 03 05:19:56.781286 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Domain-Name: None Aug 03 05:19:56.781286 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Identity-Status: Confirmed Aug 03 05:19:56.781286 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Is-Admin-Project: True Aug 03 05:19:56.781286 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Domain-Id: default Aug 03 05:19:56.781286 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Domain-Name: Default Aug 03 05:19:56.781286 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Id: 2e1ed25abd8e43009dd8f3f4b7ec1864 Aug 03 05:19:56.781286 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Name: tempest-AttachVolumeTestJSON-331802604 Aug 03 05:19:56.781286 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Role: member,reader Aug 03 05:19:56.781286 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Roles: member,reader Aug 03 05:19:56.786183 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2e1ed25abd8e43009dd8f3f4b7ec1864"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2e1ed25abd8e43009dd8f3f4b7ec1864"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2e1ed25abd8e43009dd8f3f4b7ec1864"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2e1ed25abd8e43009dd8f3f4b7ec1864"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:19:56.786183 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant: tempest-AttachVolumeTestJSON-331802604 Aug 03 05:19:56.786183 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant-Id: 2e1ed25abd8e43009dd8f3f4b7ec1864 Aug 03 05:19:56.786183 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant-Name: tempest-AttachVolumeTestJSON-331802604 Aug 03 05:19:56.786183 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User: tempest-AttachVolumeTestJSON-331802604-project Aug 03 05:19:56.786183 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Domain-Id: default Aug 03 05:19:56.786183 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Domain-Name: Default Aug 03 05:19:56.786183 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Id: f01737ba3200470c8635f335d0338ac8 Aug 03 05:19:56.786183 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Name: tempest-AttachVolumeTestJSON-331802604-project Aug 03 05:19:56.786183 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: method: > Aug 03 05:19:56.786183 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: exception: Instance ddb3fb62-23ee-4e46-b198-e30b98687d24 could not be found. Aug 03 05:19:56.786183 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: action_args: {'id': 'ddb3fb62-23ee-4e46-b198-e30b98687d24'} Aug 03 05:19:56.788182 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:19:56.788182 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:19:56.788182 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:19:56.788182 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:19:56.788182 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:19:56.788182 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:19:56.788182 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:19:56.788182 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:19:56.788182 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:19:56.788182 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:19:56.788182 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddb3fb62-23ee-4e46-b198-e30b98687d24 could not be found. Aug 03 05:19:56.788182 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:19:56.788182 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:19:56.788182 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:19:56.788182 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:19:56.788182 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:19:56.788182 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:19:56.788182 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:19:56.788182 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:19:56.788182 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:19:56.790186 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:19:56.790186 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:19:56.790186 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:19:56.790186 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:19:56.790186 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:19:56.790186 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:19:56.790186 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:19:56.790186 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddb3fb62-23ee-4e46-b198-e30b98687d24 could not be found. Aug 03 05:19:56.790186 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:19:56.790186 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:19:56.790186 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:19:56.790186 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:19:56.790186 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:19:56.790186 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:19:56.790186 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:19:56.790186 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:19:56.790186 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddb3fb62-23ee-4e46-b198-e30b98687d24 could not be found. Aug 03 05:19:56.790186 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:19:56.793924 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-f5fc5100-d0f8-4296-9865-bfcddd66c67f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Returning 404 to user: Instance ddb3fb62-23ee-4e46-b198-e30b98687d24 could not be found. {{(pid=118331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:19:56.793924 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-f5fc5100-d0f8-4296-9865-bfcddd66c67f tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24" status: 404 len: 111 microversion: 2.1 time: 0.031556 Aug 03 05:19:56.793924 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 455/876] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:56 2022] GET /compute/v2.1/servers/ddb3fb62-23ee-4e46-b198-e30b98687d24 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:19:56.817018 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-25188421-bc18-4d89-8447-3a874ff3ea06 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:56.824884 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-25188421-bc18-4d89-8447-3a874ff3ea06 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:56.826727 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-25188421-bc18-4d89-8447-3a874ff3ea06 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:56.828033 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-25188421-bc18-4d89-8447-3a874ff3ea06 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 200 len: 1715 microversion: 2.20 time: 0.175244 Aug 03 05:19:56.828634 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 422/877] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:19:56 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 1715 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:19:58.040905 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-8a6b2be3-04db-44a2-b060-4a4b7114c46d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:58.041420 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-8a6b2be3-04db-44a2-b060-4a4b7114c46d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:58.047902 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8a6b2be3-04db-44a2-b060-4a4b7114c46d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:58.048357 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8a6b2be3-04db-44a2-b060-4a4b7114c46d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:58.049123 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8a6b2be3-04db-44a2-b060-4a4b7114c46d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:58.049565 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8a6b2be3-04db-44a2-b060-4a4b7114c46d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:58.063396 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.wsgi [None req-8a6b2be3-04db-44a2-b060-4a4b7114c46d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] HTTP exception thrown: Instance 65fc13ab-3930-4958-8f59-759ba1d047b5 could not be found. Aug 03 05:19:58.064970 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-8a6b2be3-04db-44a2-b060-4a4b7114c46d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Request method failure captured: Aug 03 05:19:58.064970 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: request: DELETE /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 HTTP/1.1 Aug 03 05:19:58.064970 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Accept: application/json Aug 03 05:19:58.064970 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Accept-Encoding: identity Aug 03 05:19:58.064970 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Connection: close Aug 03 05:19:58.064970 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Content-Length: 0 Aug 03 05:19:58.064970 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Content-Type: application/json Aug 03 05:19:58.064970 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Host: 10.222.0.40 Aug 03 05:19:58.064970 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Openstack-System-Scope: None Aug 03 05:19:58.064970 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: User-Agent: python-urllib3/1.26.10 Aug 03 05:19:58.064970 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Auth-Token: gAAAAABi6gPfEYWmbBjRTCK0CUzBUvoIT1d12R6hM-5W5QKad94EcPrIuWEjzTWcdaoDev20Cjg5zI_jw18KOj7aoqrve4p1CjNeo82L37J1_7mc-_oPeqPMuwknK_3IKe4uqnCHfGy1Z4Z_S5S6r9xstkEas5zsjC0rxYdGYTaNfxf5rdAx4U0 Aug 03 05:19:58.064970 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Domain-Id: None Aug 03 05:19:58.064970 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Domain-Name: None Aug 03 05:19:58.064970 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Identity-Status: Confirmed Aug 03 05:19:58.064970 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Is-Admin-Project: True Aug 03 05:19:58.064970 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Domain-Id: default Aug 03 05:19:58.064970 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Domain-Name: Default Aug 03 05:19:58.064970 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Id: 2e1ed25abd8e43009dd8f3f4b7ec1864 Aug 03 05:19:58.064970 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Name: tempest-AttachVolumeTestJSON-331802604 Aug 03 05:19:58.064970 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Role: member,reader Aug 03 05:19:58.064970 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Roles: member,reader Aug 03 05:19:58.066540 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2e1ed25abd8e43009dd8f3f4b7ec1864"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2e1ed25abd8e43009dd8f3f4b7ec1864"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2e1ed25abd8e43009dd8f3f4b7ec1864"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2e1ed25abd8e43009dd8f3f4b7ec1864"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:19:58.066540 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant: tempest-AttachVolumeTestJSON-331802604 Aug 03 05:19:58.066540 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant-Id: 2e1ed25abd8e43009dd8f3f4b7ec1864 Aug 03 05:19:58.066540 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant-Name: tempest-AttachVolumeTestJSON-331802604 Aug 03 05:19:58.066540 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User: tempest-AttachVolumeTestJSON-331802604-project Aug 03 05:19:58.066540 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Domain-Id: default Aug 03 05:19:58.066540 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Domain-Name: Default Aug 03 05:19:58.066540 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Id: f01737ba3200470c8635f335d0338ac8 Aug 03 05:19:58.066540 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Name: tempest-AttachVolumeTestJSON-331802604-project Aug 03 05:19:58.066540 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: method: > Aug 03 05:19:58.066540 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: exception: Instance 65fc13ab-3930-4958-8f59-759ba1d047b5 could not be found. Aug 03 05:19:58.066540 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: action_args: {'id': '65fc13ab-3930-4958-8f59-759ba1d047b5'} Aug 03 05:19:58.067487 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:19:58.067487 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:19:58.067487 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:19:58.067487 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:19:58.067487 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:19:58.067487 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:19:58.067487 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:19:58.067487 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:19:58.067487 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:19:58.067487 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:19:58.067487 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65fc13ab-3930-4958-8f59-759ba1d047b5 could not be found. Aug 03 05:19:58.067487 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:19:58.067487 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:19:58.067487 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:19:58.067487 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:19:58.067487 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:19:58.067487 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:19:58.067487 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:19:58.067487 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:19:58.067487 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:19:58.069326 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:19:58.069326 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 05:19:58.069326 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 05:19:58.069326 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 05:19:58.069326 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 05:19:58.069326 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:19:58.069326 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:19:58.069326 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:19:58.069326 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:19:58.069326 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65fc13ab-3930-4958-8f59-759ba1d047b5 could not be found. Aug 03 05:19:58.069326 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:19:58.069326 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:19:58.069326 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:19:58.069326 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:19:58.069326 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:19:58.069326 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:19:58.069326 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:19:58.069326 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:19:58.069326 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65fc13ab-3930-4958-8f59-759ba1d047b5 could not be found. Aug 03 05:19:58.069326 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:19:58.070819 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-8a6b2be3-04db-44a2-b060-4a4b7114c46d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Returning 404 to user: Instance 65fc13ab-3930-4958-8f59-759ba1d047b5 could not be found. {{(pid=118331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:19:58.070819 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-8a6b2be3-04db-44a2-b060-4a4b7114c46d tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "DELETE /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5" status: 404 len: 111 microversion: 2.1 time: 0.029306 Aug 03 05:19:58.070819 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 456/878] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Aug 3 05:19:58 2022] DELETE /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:19:58.074889 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-3b744570-4d1e-4bf0-bc0c-62b0cfa41ab0 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:58.075505 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-3b744570-4d1e-4bf0-bc0c-62b0cfa41ab0 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] [instance: 65fc13ab-3930-4958-8f59-759ba1d047b5] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:58.082862 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3b744570-4d1e-4bf0-bc0c-62b0cfa41ab0 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:58.083326 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3b744570-4d1e-4bf0-bc0c-62b0cfa41ab0 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:58.084086 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3b744570-4d1e-4bf0-bc0c-62b0cfa41ab0 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:58.084522 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3b744570-4d1e-4bf0-bc0c-62b0cfa41ab0 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:58.097644 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.wsgi [None req-3b744570-4d1e-4bf0-bc0c-62b0cfa41ab0 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] HTTP exception thrown: Instance 65fc13ab-3930-4958-8f59-759ba1d047b5 could not be found. Aug 03 05:19:58.099306 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-3b744570-4d1e-4bf0-bc0c-62b0cfa41ab0 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Request method failure captured: Aug 03 05:19:58.099306 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: request: GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 HTTP/1.1 Aug 03 05:19:58.099306 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Accept: application/json Aug 03 05:19:58.099306 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Accept-Encoding: identity Aug 03 05:19:58.099306 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Connection: close Aug 03 05:19:58.099306 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Content-Length: 0 Aug 03 05:19:58.099306 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Content-Type: application/json Aug 03 05:19:58.099306 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Host: 10.222.0.40 Aug 03 05:19:58.099306 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Openstack-System-Scope: None Aug 03 05:19:58.099306 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: User-Agent: python-urllib3/1.26.10 Aug 03 05:19:58.099306 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Auth-Token: gAAAAABi6gPfEYWmbBjRTCK0CUzBUvoIT1d12R6hM-5W5QKad94EcPrIuWEjzTWcdaoDev20Cjg5zI_jw18KOj7aoqrve4p1CjNeo82L37J1_7mc-_oPeqPMuwknK_3IKe4uqnCHfGy1Z4Z_S5S6r9xstkEas5zsjC0rxYdGYTaNfxf5rdAx4U0 Aug 03 05:19:58.099306 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Domain-Id: None Aug 03 05:19:58.099306 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Domain-Name: None Aug 03 05:19:58.099306 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Identity-Status: Confirmed Aug 03 05:19:58.099306 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Is-Admin-Project: True Aug 03 05:19:58.099306 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Domain-Id: default Aug 03 05:19:58.099306 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Domain-Name: Default Aug 03 05:19:58.099306 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Id: 2e1ed25abd8e43009dd8f3f4b7ec1864 Aug 03 05:19:58.099306 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Name: tempest-AttachVolumeTestJSON-331802604 Aug 03 05:19:58.099306 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Role: member,reader Aug 03 05:19:58.099306 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Roles: member,reader Aug 03 05:19:58.100864 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2e1ed25abd8e43009dd8f3f4b7ec1864"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2e1ed25abd8e43009dd8f3f4b7ec1864"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2e1ed25abd8e43009dd8f3f4b7ec1864"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2e1ed25abd8e43009dd8f3f4b7ec1864"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:19:58.100864 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant: tempest-AttachVolumeTestJSON-331802604 Aug 03 05:19:58.100864 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant-Id: 2e1ed25abd8e43009dd8f3f4b7ec1864 Aug 03 05:19:58.100864 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant-Name: tempest-AttachVolumeTestJSON-331802604 Aug 03 05:19:58.100864 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User: tempest-AttachVolumeTestJSON-331802604-project Aug 03 05:19:58.100864 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Domain-Id: default Aug 03 05:19:58.100864 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Domain-Name: Default Aug 03 05:19:58.100864 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Id: f01737ba3200470c8635f335d0338ac8 Aug 03 05:19:58.100864 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Name: tempest-AttachVolumeTestJSON-331802604-project Aug 03 05:19:58.100864 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: method: > Aug 03 05:19:58.100864 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: exception: Instance 65fc13ab-3930-4958-8f59-759ba1d047b5 could not be found. Aug 03 05:19:58.100864 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: action_args: {'id': '65fc13ab-3930-4958-8f59-759ba1d047b5'} Aug 03 05:19:58.101742 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:19:58.101742 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:19:58.101742 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:19:58.101742 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:19:58.101742 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:19:58.101742 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:19:58.101742 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:19:58.101742 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:19:58.101742 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:19:58.101742 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:19:58.101742 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65fc13ab-3930-4958-8f59-759ba1d047b5 could not be found. Aug 03 05:19:58.101742 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:19:58.101742 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:19:58.101742 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:19:58.101742 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:19:58.101742 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:19:58.101742 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:19:58.101742 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:19:58.101742 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:19:58.101742 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:19:58.103213 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:19:58.103213 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:19:58.103213 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:19:58.103213 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:19:58.103213 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:19:58.103213 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:19:58.103213 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:19:58.103213 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65fc13ab-3930-4958-8f59-759ba1d047b5 could not be found. Aug 03 05:19:58.103213 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:19:58.103213 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:19:58.103213 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:19:58.103213 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:19:58.103213 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:19:58.103213 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:19:58.103213 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:19:58.103213 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:19:58.103213 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65fc13ab-3930-4958-8f59-759ba1d047b5 could not be found. Aug 03 05:19:58.103213 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:19:58.104519 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-3b744570-4d1e-4bf0-bc0c-62b0cfa41ab0 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] Returning 404 to user: Instance 65fc13ab-3930-4958-8f59-759ba1d047b5 could not be found. {{(pid=118332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:19:58.104519 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-3b744570-4d1e-4bf0-bc0c-62b0cfa41ab0 tempest-AttachVolumeTestJSON-331802604 tempest-AttachVolumeTestJSON-331802604-project] 10.222.0.40 "GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5" status: 404 len: 111 microversion: 2.1 time: 0.029670 Aug 03 05:19:58.104519 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 423/879] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:58 2022] GET /compute/v2.1/servers/65fc13ab-3930-4958-8f59-759ba1d047b5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:20:03.983153 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-2040194e-0f7f-4b4b-ae3a-1df023d9764f tempest-VolumesGetTestJSON-233735716 tempest-VolumesGetTestJSON-233735716-project] Action: 'create', calling method: .version_select at 0x7f7601f22e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-620094444", "metadata": {"Type": "work"}}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:20:04.629789 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-2040194e-0f7f-4b4b-ae3a-1df023d9764f tempest-VolumesGetTestJSON-233735716 tempest-VolumesGetTestJSON-233735716-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.773167 Aug 03 05:20:04.630453 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 457/880] 10.222.0.40 () {60 vars in 1156 bytes} [Wed Aug 3 05:20:03 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 774 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 03 05:20:04.643271 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-37777ee7-c2e6-4d5a-be73-fc4c88e72f68 tempest-VolumesGetTestJSON-233735716 tempest-VolumesGetTestJSON-233735716-project] Calling method '.version_select at 0x7f7601d841f0>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:20:04.698670 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-37777ee7-c2e6-4d5a-be73-fc4c88e72f68 tempest-VolumesGetTestJSON-233735716 tempest-VolumesGetTestJSON-233735716-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/d005a476-78ae-493d-97b5-42a3e6546ee7" status: 200 len: 352 microversion: 2.1 time: 0.059784 Aug 03 05:20:04.699283 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 424/881] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Aug 3 05:20:04 2022] GET /compute/v2.1/os-volumes/d005a476-78ae-493d-97b5-42a3e6546ee7 => generated 352 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:20:05.714157 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-3aefb926-18f7-48fa-98b6-c8bfbf28fc51 tempest-VolumesGetTestJSON-233735716 tempest-VolumesGetTestJSON-233735716-project] Calling method '.version_select at 0x7f7601ea23a0>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:20:05.764454 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-3aefb926-18f7-48fa-98b6-c8bfbf28fc51 tempest-VolumesGetTestJSON-233735716 tempest-VolumesGetTestJSON-233735716-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/d005a476-78ae-493d-97b5-42a3e6546ee7" status: 200 len: 352 microversion: 2.1 time: 0.054951 Aug 03 05:20:05.765103 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 458/882] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Aug 3 05:20:05 2022] GET /compute/v2.1/os-volumes/d005a476-78ae-493d-97b5-42a3e6546ee7 => generated 352 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:20:06.778793 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-9b898c84-8d1b-4402-9c1a-bb0be95485b3 tempest-VolumesGetTestJSON-233735716 tempest-VolumesGetTestJSON-233735716-project] Calling method '.version_select at 0x7f7601d58c10>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:20:06.825642 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-9b898c84-8d1b-4402-9c1a-bb0be95485b3 tempest-VolumesGetTestJSON-233735716 tempest-VolumesGetTestJSON-233735716-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/d005a476-78ae-493d-97b5-42a3e6546ee7" status: 200 len: 352 microversion: 2.1 time: 0.051091 Aug 03 05:20:06.826198 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 425/883] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Aug 3 05:20:06 2022] GET /compute/v2.1/os-volumes/d005a476-78ae-493d-97b5-42a3e6546ee7 => generated 352 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:20:07.840817 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-c02c7d35-4e23-44c0-9b0f-dd70ec7a8adb tempest-VolumesGetTestJSON-233735716 tempest-VolumesGetTestJSON-233735716-project] Calling method '.version_select at 0x7f76067c18b0>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:20:07.887330 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-c02c7d35-4e23-44c0-9b0f-dd70ec7a8adb tempest-VolumesGetTestJSON-233735716 tempest-VolumesGetTestJSON-233735716-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/d005a476-78ae-493d-97b5-42a3e6546ee7" status: 200 len: 353 microversion: 2.1 time: 0.050828 Aug 03 05:20:07.887894 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 459/884] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Aug 3 05:20:07 2022] GET /compute/v2.1/os-volumes/d005a476-78ae-493d-97b5-42a3e6546ee7 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:20:07.901246 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-da86eef6-6ffb-4846-b756-b29e8c5a3958 tempest-VolumesGetTestJSON-233735716 tempest-VolumesGetTestJSON-233735716-project] Calling method '.version_select at 0x7f7601d65e50>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:20:07.947151 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-da86eef6-6ffb-4846-b756-b29e8c5a3958 tempest-VolumesGetTestJSON-233735716 tempest-VolumesGetTestJSON-233735716-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/d005a476-78ae-493d-97b5-42a3e6546ee7" status: 200 len: 353 microversion: 2.1 time: 0.050856 Aug 03 05:20:07.947733 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 426/885] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Aug 3 05:20:07 2022] GET /compute/v2.1/os-volumes/d005a476-78ae-493d-97b5-42a3e6546ee7 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:20:07.964998 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-2bd6a456-1444-4d5f-8665-d6d1b1b23c3d tempest-VolumesGetTestJSON-233735716 tempest-VolumesGetTestJSON-233735716-project] Calling method '.version_select at 0x7f76067e91f0>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:20:08.045113 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:20:08.054193 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=57 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:20:08.133932 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-2bd6a456-1444-4d5f-8665-d6d1b1b23c3d tempest-VolumesGetTestJSON-233735716 tempest-VolumesGetTestJSON-233735716-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/d005a476-78ae-493d-97b5-42a3e6546ee7" status: 202 len: 0 microversion: 2.1 time: 0.172656 Aug 03 05:20:08.134540 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 460/886] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Aug 3 05:20:07 2022] DELETE /compute/v2.1/os-volumes/d005a476-78ae-493d-97b5-42a3e6546ee7 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:20:08.140375 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:20:08.140603 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_cell1:SELECT=45 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:20:08.144671 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-cee018f3-1e9f-4a31-bbe8-82bf671d32e9 tempest-VolumesGetTestJSON-233735716 tempest-VolumesGetTestJSON-233735716-project] Calling method '.version_select at 0x7f7601da3c10>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:20:08.194617 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-cee018f3-1e9f-4a31-bbe8-82bf671d32e9 tempest-VolumesGetTestJSON-233735716 tempest-VolumesGetTestJSON-233735716-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/d005a476-78ae-493d-97b5-42a3e6546ee7" status: 200 len: 352 microversion: 2.1 time: 0.055747 Aug 03 05:20:08.200983 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 427/887] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Aug 3 05:20:08 2022] GET /compute/v2.1/os-volumes/d005a476-78ae-493d-97b5-42a3e6546ee7 => generated 352 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:20:09.209820 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-052060e4-861d-4fc9-b74c-56126f5d9351 tempest-VolumesGetTestJSON-233735716 tempest-VolumesGetTestJSON-233735716-project] Calling method '.version_select at 0x7f7601ec20d0>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:20:09.237869 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.wsgi [None req-052060e4-861d-4fc9-b74c-56126f5d9351 tempest-VolumesGetTestJSON-233735716 tempest-VolumesGetTestJSON-233735716-project] HTTP exception thrown: Volume d005a476-78ae-493d-97b5-42a3e6546ee7 could not be found. Aug 03 05:20:09.250439 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-052060e4-861d-4fc9-b74c-56126f5d9351 tempest-VolumesGetTestJSON-233735716 tempest-VolumesGetTestJSON-233735716-project] Request method failure captured: Aug 03 05:20:09.250439 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: request: GET /compute/v2.1/os-volumes/d005a476-78ae-493d-97b5-42a3e6546ee7 HTTP/1.1 Aug 03 05:20:09.250439 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Accept: application/json Aug 03 05:20:09.250439 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Accept-Encoding: identity Aug 03 05:20:09.250439 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Connection: close Aug 03 05:20:09.250439 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Content-Length: 0 Aug 03 05:20:09.250439 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Content-Type: application/json Aug 03 05:20:09.250439 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Host: 10.222.0.40 Aug 03 05:20:09.250439 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Openstack-System-Scope: None Aug 03 05:20:09.250439 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: User-Agent: python-urllib3/1.26.10 Aug 03 05:20:09.250439 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Auth-Token: gAAAAABi6gWDJMIvl3g-Ur8m38ZccfXHrmrcz5qQ8h5qJP1_ArXvfp9S7C-BXpWbv0dl8no7vJ-aKqnDIMJiJLXb5hKWyWy3ToaPKC896pD9I0TCy4Q9-KaqrkZ7F4dtcZhrwXR5M0AYcyQTsnXoVxDD0O2NLbXb0wU-H5K9GDspt1CHxAfYTyY Aug 03 05:20:09.250439 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Domain-Id: None Aug 03 05:20:09.250439 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Domain-Name: None Aug 03 05:20:09.250439 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Identity-Status: Confirmed Aug 03 05:20:09.250439 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Is-Admin-Project: True Aug 03 05:20:09.250439 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Domain-Id: default Aug 03 05:20:09.250439 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Domain-Name: Default Aug 03 05:20:09.250439 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Id: ac58d12fea0842589f9fb0b50d01af47 Aug 03 05:20:09.250439 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Name: tempest-VolumesGetTestJSON-233735716 Aug 03 05:20:09.250439 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Role: member,reader Aug 03 05:20:09.250439 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Roles: member,reader Aug 03 05:20:09.252514 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ac58d12fea0842589f9fb0b50d01af47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ac58d12fea0842589f9fb0b50d01af47"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ac58d12fea0842589f9fb0b50d01af47"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ac58d12fea0842589f9fb0b50d01af47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:20:09.252514 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant: tempest-VolumesGetTestJSON-233735716 Aug 03 05:20:09.252514 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant-Id: ac58d12fea0842589f9fb0b50d01af47 Aug 03 05:20:09.252514 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant-Name: tempest-VolumesGetTestJSON-233735716 Aug 03 05:20:09.252514 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User: tempest-VolumesGetTestJSON-233735716-project Aug 03 05:20:09.252514 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Domain-Id: default Aug 03 05:20:09.252514 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Domain-Name: Default Aug 03 05:20:09.252514 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Id: 3c0509f1249b45c3914f59db2dc936a3 Aug 03 05:20:09.252514 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Name: tempest-VolumesGetTestJSON-233735716-project Aug 03 05:20:09.252514 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: method: Aug 03 05:20:09.252514 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: exception: Volume d005a476-78ae-493d-97b5-42a3e6546ee7 could not be found. Aug 03 05:20:09.252514 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: action_args: {'id': 'd005a476-78ae-493d-97b5-42a3e6546ee7'} Aug 03 05:20:09.252514 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:20:09.253336 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:20:09.253336 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 05:20:09.253336 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 05:20:09.253336 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 05:20:09.253336 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 05:20:09.253336 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 05:20:09.253336 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 05:20:09.253336 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 05:20:09.253336 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 05:20:09.253336 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 05:20:09.253336 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 05:20:09.253336 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 05:20:09.253336 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 05:20:09.253336 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 05:20:09.253336 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 05:20:09.253336 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d005a476-78ae-493d-97b5-42a3e6546ee7 could not be found. (HTTP 404) (Request-ID: req-fed14f3c-626b-4125-987c-a202365de0cc) Aug 03 05:20:09.253336 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:20:09.253336 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:20:09.253336 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:20:09.254859 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:20:09.254859 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 03 05:20:09.254859 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 03 05:20:09.254859 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 05:20:09.254859 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 05:20:09.254859 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 05:20:09.254859 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 05:20:09.254859 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 05:20:09.254859 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 05:20:09.254859 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 05:20:09.254859 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 05:20:09.254859 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 05:20:09.254859 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 05:20:09.254859 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 05:20:09.254859 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 05:20:09.254859 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 05:20:09.254859 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 05:20:09.254859 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 05:20:09.254859 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 05:20:09.256493 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 05:20:09.256493 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 05:20:09.256493 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 05:20:09.256493 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 05:20:09.256493 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d005a476-78ae-493d-97b5-42a3e6546ee7 could not be found. Aug 03 05:20:09.256493 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:20:09.256493 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:20:09.256493 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:20:09.256493 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:20:09.256493 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:20:09.256493 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:20:09.256493 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:20:09.256493 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:20:09.256493 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 05:20:09.256493 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 05:20:09.256493 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:20:09.256493 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:20:09.256493 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 03 05:20:09.256493 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:20:09.257891 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d005a476-78ae-493d-97b5-42a3e6546ee7 could not be found. Aug 03 05:20:09.257891 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:20:09.257891 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:20:09.257891 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:20:09.257891 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:20:09.257891 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:20:09.257891 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:20:09.257891 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:20:09.257891 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:20:09.257891 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d005a476-78ae-493d-97b5-42a3e6546ee7 could not be found. Aug 03 05:20:09.257891 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:20:09.257891 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-052060e4-861d-4fc9-b74c-56126f5d9351 tempest-VolumesGetTestJSON-233735716 tempest-VolumesGetTestJSON-233735716-project] Returning 404 to user: Volume d005a476-78ae-493d-97b5-42a3e6546ee7 could not be found. {{(pid=118331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:20:09.257891 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-052060e4-861d-4fc9-b74c-56126f5d9351 tempest-VolumesGetTestJSON-233735716 tempest-VolumesGetTestJSON-233735716-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/d005a476-78ae-493d-97b5-42a3e6546ee7" status: 404 len: 109 microversion: 2.1 time: 0.047856 Aug 03 05:20:09.257891 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 461/888] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Aug 3 05:20:09 2022] GET /compute/v2.1/os-volumes/d005a476-78ae-493d-97b5-42a3e6546ee7 => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:20:26.232292 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-8169d1a5-5645-4a43-be0c-ba3273f252df tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Action: 'create', calling method: .version_select at 0x7f7601ce6670>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1057909603", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMYprOQy73fpX3bLk7FHAmI1CBFbetJFpmpGUyxrypAljAMTkQHW0U3iPE5F5CmT/Qt4Nq4suiaRxA1Wvg5Zum2thzMxR0YqEXh7jDTluDfixeSaSbeJr6unIIt934J3Ww=="}} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:20:26.252026 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.quota [None req-8169d1a5-5645-4a43-be0c-ba3273f252df tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Getting quotas for project 3c986ef0f5ea46f9b5e788aaca042b06. Resources: {'key_pairs'} {{(pid=118332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:20:26.256333 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.quota [None req-8169d1a5-5645-4a43-be0c-ba3273f252df tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Getting quotas for user ac3954ab39014ef3819111a6fe8142b7 and project 3c986ef0f5ea46f9b5e788aaca042b06. Resources: {'key_pairs'} {{(pid=118332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:20:26.339038 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-8169d1a5-5645-4a43-be0c-ba3273f252df tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.408224 Aug 03 05:20:26.340029 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 428/889] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Aug 3 05:20:25 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:20:29.587774 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-a90b3d2a-0450-4cc4-9a96-4a0cd69e032f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:20:29.588263 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-a90b3d2a-0450-4cc4-9a96-4a0cd69e032f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:20:29.597635 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a90b3d2a-0450-4cc4-9a96-4a0cd69e032f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:29.598223 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a90b3d2a-0450-4cc4-9a96-4a0cd69e032f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:29.599109 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a90b3d2a-0450-4cc4-9a96-4a0cd69e032f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:29.599558 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a90b3d2a-0450-4cc4-9a96-4a0cd69e032f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:29.628943 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-a90b3d2a-0450-4cc4-9a96-4a0cd69e032f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049592 Aug 03 05:20:29.629516 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 462/890] 10.222.0.40 () {60 vars in 1343 bytes} [Wed Aug 3 05:20:29 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:20:29.692005 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-1da31a5d-33ad-4352-8418-f6ed3849319b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:20:29.692522 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-1da31a5d-33ad-4352-8418-f6ed3849319b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:20:29.699171 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-1da31a5d-33ad-4352-8418-f6ed3849319b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:29.699621 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-1da31a5d-33ad-4352-8418-f6ed3849319b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:29.700374 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-1da31a5d-33ad-4352-8418-f6ed3849319b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:29.700807 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-1da31a5d-33ad-4352-8418-f6ed3849319b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:29.726541 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-1da31a5d-33ad-4352-8418-f6ed3849319b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Going to try to terminate instance {{(pid=118332) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:20:30.082223 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-1da31a5d-33ad-4352-8418-f6ed3849319b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "DELETE /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 204 len: 0 microversion: 2.20 time: 0.393801 Aug 03 05:20:30.083067 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 429/891] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Aug 3 05:20:29 2022] DELETE /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 05:20:30.091878 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-edb3e52d-ea51-4f9c-a8f1-f2f32bfbecad tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:20:30.092673 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-edb3e52d-ea51-4f9c-a8f1-f2f32bfbecad tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:20:30.099556 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-edb3e52d-ea51-4f9c-a8f1-f2f32bfbecad tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:30.100014 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-edb3e52d-ea51-4f9c-a8f1-f2f32bfbecad tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:30.100798 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-edb3e52d-ea51-4f9c-a8f1-f2f32bfbecad tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:30.101244 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-edb3e52d-ea51-4f9c-a8f1-f2f32bfbecad tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:30.241507 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-edb3e52d-ea51-4f9c-a8f1-f2f32bfbecad tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:20:30.249621 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-edb3e52d-ea51-4f9c-a8f1-f2f32bfbecad tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:20:30.251550 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-edb3e52d-ea51-4f9c-a8f1-f2f32bfbecad tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:20:30.253421 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-edb3e52d-ea51-4f9c-a8f1-f2f32bfbecad tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 200 len: 1721 microversion: 2.20 time: 0.165859 Aug 03 05:20:30.254166 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 463/892] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:20:30 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 05:20:31.279157 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-2c396566-d8e8-41a8-89ec-686c234b635b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:20:31.279918 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-2c396566-d8e8-41a8-89ec-686c234b635b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:20:31.287779 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-2c396566-d8e8-41a8-89ec-686c234b635b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:31.288233 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-2c396566-d8e8-41a8-89ec-686c234b635b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:31.289010 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-2c396566-d8e8-41a8-89ec-686c234b635b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:31.289521 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-2c396566-d8e8-41a8-89ec-686c234b635b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:31.429138 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-2c396566-d8e8-41a8-89ec-686c234b635b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:20:31.438605 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-2c396566-d8e8-41a8-89ec-686c234b635b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:20:31.440188 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-2c396566-d8e8-41a8-89ec-686c234b635b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:20:31.441468 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-2c396566-d8e8-41a8-89ec-686c234b635b tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 200 len: 1721 microversion: 2.20 time: 0.167185 Aug 03 05:20:31.442031 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 430/893] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:20:31 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:20:32.470008 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-d62c2574-33ff-4cb3-a767-881973efda64 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:20:32.471132 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-d62c2574-33ff-4cb3-a767-881973efda64 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:20:32.477692 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d62c2574-33ff-4cb3-a767-881973efda64 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:32.478157 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d62c2574-33ff-4cb3-a767-881973efda64 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:32.478961 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d62c2574-33ff-4cb3-a767-881973efda64 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:32.479408 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d62c2574-33ff-4cb3-a767-881973efda64 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:32.609701 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-d62c2574-33ff-4cb3-a767-881973efda64 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:20:32.618611 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-d62c2574-33ff-4cb3-a767-881973efda64 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:20:32.620383 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-d62c2574-33ff-4cb3-a767-881973efda64 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:20:32.621633 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-d62c2574-33ff-4cb3-a767-881973efda64 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 200 len: 1721 microversion: 2.20 time: 0.155543 Aug 03 05:20:32.622206 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 464/894] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:20:32 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 05:20:33.647136 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-16aeff87-b7dd-4ec1-813f-fbe4739a1b04 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:20:33.647775 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-16aeff87-b7dd-4ec1-813f-fbe4739a1b04 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:20:33.655919 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-16aeff87-b7dd-4ec1-813f-fbe4739a1b04 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:33.656380 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-16aeff87-b7dd-4ec1-813f-fbe4739a1b04 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:33.657451 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-16aeff87-b7dd-4ec1-813f-fbe4739a1b04 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:33.657916 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-16aeff87-b7dd-4ec1-813f-fbe4739a1b04 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:33.894468 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-16aeff87-b7dd-4ec1-813f-fbe4739a1b04 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:20:33.902719 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-16aeff87-b7dd-4ec1-813f-fbe4739a1b04 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:20:33.904194 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-16aeff87-b7dd-4ec1-813f-fbe4739a1b04 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:20:33.905364 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-16aeff87-b7dd-4ec1-813f-fbe4739a1b04 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 200 len: 1721 microversion: 2.20 time: 0.265448 Aug 03 05:20:33.906035 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 431/895] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:20:33 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 1721 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:20:34.687343 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-462dbdc5-1844-4265-bb63-30bf9174d432 req-7aa67a20-f6df-4de6-a4b3-6f648872f1a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67b3164b-4fb1-4812-94b7-cc60b3040700", "name": "network-vif-deleted", "tag": "ac9d083a-77d7-4d9d-a0ea-ee7b9f6e3aab"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:20:34.700506 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-462dbdc5-1844-4265-bb63-30bf9174d432 req-7aa67a20-f6df-4de6-a4b3-6f648872f1a1 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:34.702971 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-462dbdc5-1844-4265-bb63-30bf9174d432 req-7aa67a20-f6df-4de6-a4b3-6f648872f1a1 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:34.713532 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-462dbdc5-1844-4265-bb63-30bf9174d432 req-7aa67a20-f6df-4de6-a4b3-6f648872f1a1 service nova] Creating event network-vif-deleted:ac9d083a-77d7-4d9d-a0ea-ee7b9f6e3aab for instance 67b3164b-4fb1-4812-94b7-cc60b3040700 on hv-cinder-85127 Aug 03 05:20:34.718974 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-462dbdc5-1844-4265-bb63-30bf9174d432 req-7aa67a20-f6df-4de6-a4b3-6f648872f1a1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035237 Aug 03 05:20:34.720025 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 465/896] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:20:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:20:34.929249 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-a1c39073-2412-4b59-bec1-0b5321ef3423 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:20:34.930266 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-a1c39073-2412-4b59-bec1-0b5321ef3423 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:20:34.942936 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-a1c39073-2412-4b59-bec1-0b5321ef3423 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:34.943400 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-a1c39073-2412-4b59-bec1-0b5321ef3423 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:34.944221 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-a1c39073-2412-4b59-bec1-0b5321ef3423 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:34.944653 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-a1c39073-2412-4b59-bec1-0b5321ef3423 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:35.034093 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-a1c39073-2412-4b59-bec1-0b5321ef3423 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:20:35.046787 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-a1c39073-2412-4b59-bec1-0b5321ef3423 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:20:35.046787 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-a1c39073-2412-4b59-bec1-0b5321ef3423 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '747a608061504d7693f0f99ecdfa476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050592077e0b4d26a1555d2daa7f460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:20:35.048037 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-a1c39073-2412-4b59-bec1-0b5321ef3423 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 200 len: 1366 microversion: 2.20 time: 0.122947 Aug 03 05:20:35.049320 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 432/897] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:20:34 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 1366 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:20:36.086181 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-276ac4b6-9c72-493f-9a28-865912278d11 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:20:36.086898 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-276ac4b6-9c72-493f-9a28-865912278d11 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:20:36.093358 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-276ac4b6-9c72-493f-9a28-865912278d11 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:36.093822 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-276ac4b6-9c72-493f-9a28-865912278d11 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:36.094604 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-276ac4b6-9c72-493f-9a28-865912278d11 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:36.095084 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-276ac4b6-9c72-493f-9a28-865912278d11 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:36.108898 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.wsgi [None req-276ac4b6-9c72-493f-9a28-865912278d11 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] HTTP exception thrown: Instance 67b3164b-4fb1-4812-94b7-cc60b3040700 could not be found. Aug 03 05:20:36.110700 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-276ac4b6-9c72-493f-9a28-865912278d11 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Request method failure captured: Aug 03 05:20:36.110700 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: request: GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 HTTP/1.1 Aug 03 05:20:36.110700 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Accept: application/json Aug 03 05:20:36.110700 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Accept-Encoding: identity Aug 03 05:20:36.110700 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Connection: close Aug 03 05:20:36.110700 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Content-Length: 0 Aug 03 05:20:36.110700 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Content-Type: application/json Aug 03 05:20:36.110700 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Host: 10.222.0.40 Aug 03 05:20:36.110700 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Openstack-System-Scope: None Aug 03 05:20:36.110700 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: User-Agent: python-urllib3/1.26.10 Aug 03 05:20:36.110700 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Auth-Token: gAAAAABi6gPbNCCvHfrbanto4bj1-lel-2VikktM-wW8855hJ86FrqAD7dSHgfAHYeFZxZnlV85Hxb3VVAU_Fz2yzsJnIPiZHqm-1gOuzu_zWyJ2QCRYvy3NiidX8bl9ItEXjqMcGZQGLufjsSKHq1smtGRJyvYnd1iFXLObvq9wAij2WbeQdeU Aug 03 05:20:36.110700 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Domain-Id: None Aug 03 05:20:36.110700 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Domain-Name: None Aug 03 05:20:36.110700 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Identity-Status: Confirmed Aug 03 05:20:36.110700 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Is-Admin-Project: True Aug 03 05:20:36.110700 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Openstack-Nova-Api-Version: 2.20 Aug 03 05:20:36.110700 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Domain-Id: default Aug 03 05:20:36.110700 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Domain-Name: Default Aug 03 05:20:36.110700 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Id: 050592077e0b4d26a1555d2daa7f460d Aug 03 05:20:36.110700 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1717649029 Aug 03 05:20:36.110700 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Role: member,reader Aug 03 05:20:36.110700 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Roles: member,reader Aug 03 05:20:36.112977 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_050592077e0b4d26a1555d2daa7f460d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/050592077e0b4d26a1555d2daa7f460d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/050592077e0b4d26a1555d2daa7f460d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/050592077e0b4d26a1555d2daa7f460d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:20:36.112977 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1717649029 Aug 03 05:20:36.112977 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant-Id: 050592077e0b4d26a1555d2daa7f460d Aug 03 05:20:36.112977 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1717649029 Aug 03 05:20:36.112977 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User: tempest-AttachVolumeShelveTestJSON-1717649029-project Aug 03 05:20:36.112977 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Domain-Id: default Aug 03 05:20:36.112977 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Domain-Name: Default Aug 03 05:20:36.112977 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Id: 747a608061504d7693f0f99ecdfa476e Aug 03 05:20:36.112977 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1717649029-project Aug 03 05:20:36.112977 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: method: > Aug 03 05:20:36.112977 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: exception: Instance 67b3164b-4fb1-4812-94b7-cc60b3040700 could not be found. Aug 03 05:20:36.112977 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: action_args: {'id': '67b3164b-4fb1-4812-94b7-cc60b3040700'} Aug 03 05:20:36.113881 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:20:36.113881 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:20:36.113881 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:20:36.113881 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:20:36.113881 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:20:36.113881 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:20:36.113881 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:20:36.113881 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:20:36.113881 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:20:36.113881 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:20:36.113881 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67b3164b-4fb1-4812-94b7-cc60b3040700 could not be found. Aug 03 05:20:36.113881 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:20:36.113881 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:20:36.113881 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:20:36.113881 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:20:36.113881 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:20:36.113881 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:20:36.113881 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:20:36.113881 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:20:36.113881 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:20:36.115480 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:20:36.115480 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:20:36.115480 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:20:36.115480 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:20:36.115480 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:20:36.115480 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:20:36.115480 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:20:36.115480 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67b3164b-4fb1-4812-94b7-cc60b3040700 could not be found. Aug 03 05:20:36.115480 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:20:36.115480 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:20:36.115480 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:20:36.115480 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:20:36.115480 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:20:36.115480 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:20:36.115480 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:20:36.115480 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:20:36.115480 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67b3164b-4fb1-4812-94b7-cc60b3040700 could not be found. Aug 03 05:20:36.115480 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:20:36.117243 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-276ac4b6-9c72-493f-9a28-865912278d11 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Returning 404 to user: Instance 67b3164b-4fb1-4812-94b7-cc60b3040700 could not be found. {{(pid=118331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:20:36.117243 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-276ac4b6-9c72-493f-9a28-865912278d11 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 404 len: 111 microversion: 2.20 time: 0.030798 Aug 03 05:20:36.117243 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 466/898] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:20:36 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 05:20:36.123703 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-69100204-c6af-47d8-a18a-47eee498feef tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '.version_select at 0x7f7601d4c160>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:20:36.237000 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-69100204-c6af-47d8-a18a-47eee498feef tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1230351880" status: 204 len: 0 microversion: 2.20 time: 0.118157 Aug 03 05:20:36.238145 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 433/899] 10.222.0.40 () {60 vars in 1262 bytes} [Wed Aug 3 05:20:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1230351880 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 05:20:38.303044 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-984f1443-4d10-466a-8861-ccc9b5af62be tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:20:38.303537 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-984f1443-4d10-466a-8861-ccc9b5af62be tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:20:38.310022 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-984f1443-4d10-466a-8861-ccc9b5af62be tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:38.310486 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-984f1443-4d10-466a-8861-ccc9b5af62be tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:38.311284 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-984f1443-4d10-466a-8861-ccc9b5af62be tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:38.311731 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-984f1443-4d10-466a-8861-ccc9b5af62be tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:38.325624 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.wsgi [None req-984f1443-4d10-466a-8861-ccc9b5af62be tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] HTTP exception thrown: Instance 67b3164b-4fb1-4812-94b7-cc60b3040700 could not be found. Aug 03 05:20:38.333065 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-984f1443-4d10-466a-8861-ccc9b5af62be tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Request method failure captured: Aug 03 05:20:38.333065 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: request: DELETE /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 HTTP/1.1 Aug 03 05:20:38.333065 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Accept: application/json Aug 03 05:20:38.333065 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Accept-Encoding: identity Aug 03 05:20:38.333065 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Connection: close Aug 03 05:20:38.333065 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Content-Length: 0 Aug 03 05:20:38.333065 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Content-Type: application/json Aug 03 05:20:38.333065 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Host: 10.222.0.40 Aug 03 05:20:38.333065 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Openstack-System-Scope: None Aug 03 05:20:38.333065 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: User-Agent: python-urllib3/1.26.10 Aug 03 05:20:38.333065 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Auth-Token: gAAAAABi6gPbNCCvHfrbanto4bj1-lel-2VikktM-wW8855hJ86FrqAD7dSHgfAHYeFZxZnlV85Hxb3VVAU_Fz2yzsJnIPiZHqm-1gOuzu_zWyJ2QCRYvy3NiidX8bl9ItEXjqMcGZQGLufjsSKHq1smtGRJyvYnd1iFXLObvq9wAij2WbeQdeU Aug 03 05:20:38.333065 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Domain-Id: None Aug 03 05:20:38.333065 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Domain-Name: None Aug 03 05:20:38.333065 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Identity-Status: Confirmed Aug 03 05:20:38.333065 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Is-Admin-Project: True Aug 03 05:20:38.333065 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Openstack-Nova-Api-Version: 2.20 Aug 03 05:20:38.333065 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Domain-Id: default Aug 03 05:20:38.333065 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Domain-Name: Default Aug 03 05:20:38.333065 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Id: 050592077e0b4d26a1555d2daa7f460d Aug 03 05:20:38.333065 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1717649029 Aug 03 05:20:38.333065 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Role: member,reader Aug 03 05:20:38.333065 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Roles: member,reader Aug 03 05:20:38.334909 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_050592077e0b4d26a1555d2daa7f460d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/050592077e0b4d26a1555d2daa7f460d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/050592077e0b4d26a1555d2daa7f460d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/050592077e0b4d26a1555d2daa7f460d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:20:38.334909 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1717649029 Aug 03 05:20:38.334909 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant-Id: 050592077e0b4d26a1555d2daa7f460d Aug 03 05:20:38.334909 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1717649029 Aug 03 05:20:38.334909 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User: tempest-AttachVolumeShelveTestJSON-1717649029-project Aug 03 05:20:38.334909 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Domain-Id: default Aug 03 05:20:38.334909 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Domain-Name: Default Aug 03 05:20:38.334909 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Id: 747a608061504d7693f0f99ecdfa476e Aug 03 05:20:38.334909 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1717649029-project Aug 03 05:20:38.334909 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: method: > Aug 03 05:20:38.334909 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: exception: Instance 67b3164b-4fb1-4812-94b7-cc60b3040700 could not be found. Aug 03 05:20:38.334909 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: action_args: {'id': '67b3164b-4fb1-4812-94b7-cc60b3040700'} Aug 03 05:20:38.335877 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:20:38.335877 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:20:38.335877 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:20:38.335877 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:20:38.335877 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:20:38.335877 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:20:38.335877 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:20:38.335877 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:20:38.335877 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:20:38.335877 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:20:38.335877 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67b3164b-4fb1-4812-94b7-cc60b3040700 could not be found. Aug 03 05:20:38.335877 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:20:38.335877 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:20:38.335877 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:20:38.335877 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:20:38.335877 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:20:38.335877 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:20:38.335877 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:20:38.335877 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:20:38.335877 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:20:38.337316 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:20:38.337316 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 05:20:38.337316 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 05:20:38.337316 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 05:20:38.337316 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 05:20:38.337316 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:20:38.337316 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:20:38.337316 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:20:38.337316 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:20:38.337316 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67b3164b-4fb1-4812-94b7-cc60b3040700 could not be found. Aug 03 05:20:38.337316 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:20:38.337316 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:20:38.337316 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:20:38.337316 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:20:38.337316 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:20:38.337316 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:20:38.337316 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:20:38.337316 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:20:38.337316 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67b3164b-4fb1-4812-94b7-cc60b3040700 could not be found. Aug 03 05:20:38.337316 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:20:38.338947 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-984f1443-4d10-466a-8861-ccc9b5af62be tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Returning 404 to user: Instance 67b3164b-4fb1-4812-94b7-cc60b3040700 could not be found. {{(pid=118331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:20:38.338947 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-984f1443-4d10-466a-8861-ccc9b5af62be tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "DELETE /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 404 len: 111 microversion: 2.20 time: 0.029570 Aug 03 05:20:38.338947 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 467/900] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Aug 3 05:20:38 2022] DELETE /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 03 05:20:38.339205 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_cell0:SELECT=4 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:20:38.342016 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-c49e10da-a3cf-47a2-b4b1-7677b9567fe3 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:20:38.342718 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-c49e10da-a3cf-47a2-b4b1-7677b9567fe3 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 67b3164b-4fb1-4812-94b7-cc60b3040700] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:20:38.351351 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-c49e10da-a3cf-47a2-b4b1-7677b9567fe3 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:38.351802 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-c49e10da-a3cf-47a2-b4b1-7677b9567fe3 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:38.352600 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-c49e10da-a3cf-47a2-b4b1-7677b9567fe3 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:38.353018 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-c49e10da-a3cf-47a2-b4b1-7677b9567fe3 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:38.366462 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.wsgi [None req-c49e10da-a3cf-47a2-b4b1-7677b9567fe3 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] HTTP exception thrown: Instance 67b3164b-4fb1-4812-94b7-cc60b3040700 could not be found. Aug 03 05:20:38.368162 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-c49e10da-a3cf-47a2-b4b1-7677b9567fe3 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Request method failure captured: Aug 03 05:20:38.368162 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: request: GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 HTTP/1.1 Aug 03 05:20:38.368162 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Accept: application/json Aug 03 05:20:38.368162 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Accept-Encoding: identity Aug 03 05:20:38.368162 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Connection: close Aug 03 05:20:38.368162 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Content-Length: 0 Aug 03 05:20:38.368162 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Content-Type: application/json Aug 03 05:20:38.368162 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Host: 10.222.0.40 Aug 03 05:20:38.368162 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Openstack-System-Scope: None Aug 03 05:20:38.368162 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: User-Agent: python-urllib3/1.26.10 Aug 03 05:20:38.368162 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Auth-Token: gAAAAABi6gPbNCCvHfrbanto4bj1-lel-2VikktM-wW8855hJ86FrqAD7dSHgfAHYeFZxZnlV85Hxb3VVAU_Fz2yzsJnIPiZHqm-1gOuzu_zWyJ2QCRYvy3NiidX8bl9ItEXjqMcGZQGLufjsSKHq1smtGRJyvYnd1iFXLObvq9wAij2WbeQdeU Aug 03 05:20:38.368162 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Domain-Id: None Aug 03 05:20:38.368162 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Domain-Name: None Aug 03 05:20:38.368162 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Identity-Status: Confirmed Aug 03 05:20:38.368162 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Is-Admin-Project: True Aug 03 05:20:38.368162 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Openstack-Nova-Api-Version: 2.20 Aug 03 05:20:38.368162 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Domain-Id: default Aug 03 05:20:38.368162 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Domain-Name: Default Aug 03 05:20:38.368162 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Id: 050592077e0b4d26a1555d2daa7f460d Aug 03 05:20:38.368162 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1717649029 Aug 03 05:20:38.368162 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Role: member,reader Aug 03 05:20:38.368162 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Roles: member,reader Aug 03 05:20:38.369992 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_050592077e0b4d26a1555d2daa7f460d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/050592077e0b4d26a1555d2daa7f460d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/050592077e0b4d26a1555d2daa7f460d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/050592077e0b4d26a1555d2daa7f460d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:20:38.369992 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1717649029 Aug 03 05:20:38.369992 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant-Id: 050592077e0b4d26a1555d2daa7f460d Aug 03 05:20:38.369992 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1717649029 Aug 03 05:20:38.369992 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User: tempest-AttachVolumeShelveTestJSON-1717649029-project Aug 03 05:20:38.369992 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Domain-Id: default Aug 03 05:20:38.369992 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Domain-Name: Default Aug 03 05:20:38.369992 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Id: 747a608061504d7693f0f99ecdfa476e Aug 03 05:20:38.369992 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1717649029-project Aug 03 05:20:38.369992 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: method: > Aug 03 05:20:38.369992 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: exception: Instance 67b3164b-4fb1-4812-94b7-cc60b3040700 could not be found. Aug 03 05:20:38.369992 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: action_args: {'id': '67b3164b-4fb1-4812-94b7-cc60b3040700'} Aug 03 05:20:38.371322 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:20:38.371322 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:20:38.371322 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:20:38.371322 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:20:38.371322 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:20:38.371322 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:20:38.371322 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:20:38.371322 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:20:38.371322 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:20:38.371322 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:20:38.371322 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67b3164b-4fb1-4812-94b7-cc60b3040700 could not be found. Aug 03 05:20:38.371322 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:20:38.371322 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:20:38.371322 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:20:38.371322 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:20:38.371322 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:20:38.371322 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:20:38.371322 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:20:38.371322 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:20:38.371322 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:20:38.372568 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:20:38.372568 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:20:38.372568 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:20:38.372568 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:20:38.372568 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:20:38.372568 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:20:38.372568 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:20:38.372568 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67b3164b-4fb1-4812-94b7-cc60b3040700 could not be found. Aug 03 05:20:38.372568 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:20:38.372568 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:20:38.372568 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:20:38.372568 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:20:38.372568 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:20:38.372568 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:20:38.372568 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:20:38.372568 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:20:38.372568 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67b3164b-4fb1-4812-94b7-cc60b3040700 could not be found. Aug 03 05:20:38.372568 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:20:38.374051 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-c49e10da-a3cf-47a2-b4b1-7677b9567fe3 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Returning 404 to user: Instance 67b3164b-4fb1-4812-94b7-cc60b3040700 could not be found. {{(pid=118332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:20:38.374051 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-c49e10da-a3cf-47a2-b4b1-7677b9567fe3 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700" status: 404 len: 111 microversion: 2.20 time: 0.033422 Aug 03 05:20:38.374051 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 434/901] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:20:38 2022] GET /compute/v2.1/servers/67b3164b-4fb1-4812-94b7-cc60b3040700 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 03 05:20:39.643336 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-c3f0c330-d26f-47c5-b3c3-1d8d2203e809 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:20:39.647643 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-c3f0c330-d26f-47c5-b3c3-1d8d2203e809 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:20:39.650708 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c3f0c330-d26f-47c5-b3c3-1d8d2203e809 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:39.651134 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c3f0c330-d26f-47c5-b3c3-1d8d2203e809 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:39.651892 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c3f0c330-d26f-47c5-b3c3-1d8d2203e809 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:39.652327 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c3f0c330-d26f-47c5-b3c3-1d8d2203e809 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:39.668096 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.wsgi [None req-c3f0c330-d26f-47c5-b3c3-1d8d2203e809 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] HTTP exception thrown: Instance 69089938-1d69-415c-8344-e6b9f78f16d1 could not be found. Aug 03 05:20:39.672700 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-c3f0c330-d26f-47c5-b3c3-1d8d2203e809 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Request method failure captured: Aug 03 05:20:39.672700 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: request: DELETE /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 HTTP/1.1 Aug 03 05:20:39.672700 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Accept: application/json Aug 03 05:20:39.672700 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Accept-Encoding: identity Aug 03 05:20:39.672700 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Connection: close Aug 03 05:20:39.672700 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Content-Length: 0 Aug 03 05:20:39.672700 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Content-Type: application/json Aug 03 05:20:39.672700 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Host: 10.222.0.40 Aug 03 05:20:39.672700 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Openstack-System-Scope: None Aug 03 05:20:39.672700 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: User-Agent: python-urllib3/1.26.10 Aug 03 05:20:39.672700 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Auth-Token: gAAAAABi6gPbNCCvHfrbanto4bj1-lel-2VikktM-wW8855hJ86FrqAD7dSHgfAHYeFZxZnlV85Hxb3VVAU_Fz2yzsJnIPiZHqm-1gOuzu_zWyJ2QCRYvy3NiidX8bl9ItEXjqMcGZQGLufjsSKHq1smtGRJyvYnd1iFXLObvq9wAij2WbeQdeU Aug 03 05:20:39.672700 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Domain-Id: None Aug 03 05:20:39.672700 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Domain-Name: None Aug 03 05:20:39.672700 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Identity-Status: Confirmed Aug 03 05:20:39.672700 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Is-Admin-Project: True Aug 03 05:20:39.672700 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Openstack-Nova-Api-Version: 2.20 Aug 03 05:20:39.672700 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Domain-Id: default Aug 03 05:20:39.672700 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Domain-Name: Default Aug 03 05:20:39.672700 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Id: 050592077e0b4d26a1555d2daa7f460d Aug 03 05:20:39.672700 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1717649029 Aug 03 05:20:39.672700 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Role: member,reader Aug 03 05:20:39.672700 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Roles: member,reader Aug 03 05:20:39.674311 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_050592077e0b4d26a1555d2daa7f460d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/050592077e0b4d26a1555d2daa7f460d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/050592077e0b4d26a1555d2daa7f460d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/050592077e0b4d26a1555d2daa7f460d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:20:39.674311 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1717649029 Aug 03 05:20:39.674311 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant-Id: 050592077e0b4d26a1555d2daa7f460d Aug 03 05:20:39.674311 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1717649029 Aug 03 05:20:39.674311 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User: tempest-AttachVolumeShelveTestJSON-1717649029-project Aug 03 05:20:39.674311 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Domain-Id: default Aug 03 05:20:39.674311 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Domain-Name: Default Aug 03 05:20:39.674311 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Id: 747a608061504d7693f0f99ecdfa476e Aug 03 05:20:39.674311 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1717649029-project Aug 03 05:20:39.674311 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: method: > Aug 03 05:20:39.674311 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: exception: Instance 69089938-1d69-415c-8344-e6b9f78f16d1 could not be found. Aug 03 05:20:39.674311 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: action_args: {'id': '69089938-1d69-415c-8344-e6b9f78f16d1'} Aug 03 05:20:39.675179 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:20:39.675179 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:20:39.675179 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:20:39.675179 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:20:39.675179 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:20:39.675179 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:20:39.675179 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:20:39.675179 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:20:39.675179 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:20:39.675179 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:20:39.675179 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69089938-1d69-415c-8344-e6b9f78f16d1 could not be found. Aug 03 05:20:39.675179 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:20:39.675179 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:20:39.675179 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:20:39.675179 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:20:39.675179 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:20:39.675179 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:20:39.675179 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:20:39.675179 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:20:39.675179 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:20:39.677174 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:20:39.677174 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 05:20:39.677174 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 05:20:39.677174 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 05:20:39.677174 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 05:20:39.677174 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:20:39.677174 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:20:39.677174 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:20:39.677174 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:20:39.677174 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69089938-1d69-415c-8344-e6b9f78f16d1 could not be found. Aug 03 05:20:39.677174 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:20:39.677174 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:20:39.677174 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:20:39.677174 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:20:39.677174 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:20:39.677174 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:20:39.677174 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:20:39.677174 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:20:39.677174 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69089938-1d69-415c-8344-e6b9f78f16d1 could not be found. Aug 03 05:20:39.677174 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:20:39.678771 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-c3f0c330-d26f-47c5-b3c3-1d8d2203e809 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Returning 404 to user: Instance 69089938-1d69-415c-8344-e6b9f78f16d1 could not be found. {{(pid=118331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:20:39.678771 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-c3f0c330-d26f-47c5-b3c3-1d8d2203e809 tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "DELETE /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 404 len: 111 microversion: 2.20 time: 0.031755 Aug 03 05:20:39.678771 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 468/902] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Aug 3 05:20:39 2022] DELETE /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 05:20:39.680648 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-3fdbee29-a78a-445f-8ff6-295d46b4905f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:20:39.681298 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-3fdbee29-a78a-445f-8ff6-295d46b4905f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] [instance: 69089938-1d69-415c-8344-e6b9f78f16d1] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:20:39.688279 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3fdbee29-a78a-445f-8ff6-295d46b4905f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:39.688760 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3fdbee29-a78a-445f-8ff6-295d46b4905f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:39.689534 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3fdbee29-a78a-445f-8ff6-295d46b4905f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:39.689979 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3fdbee29-a78a-445f-8ff6-295d46b4905f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:39.706629 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.wsgi [None req-3fdbee29-a78a-445f-8ff6-295d46b4905f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] HTTP exception thrown: Instance 69089938-1d69-415c-8344-e6b9f78f16d1 could not be found. Aug 03 05:20:39.708229 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-3fdbee29-a78a-445f-8ff6-295d46b4905f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Request method failure captured: Aug 03 05:20:39.708229 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: request: GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 HTTP/1.1 Aug 03 05:20:39.708229 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Accept: application/json Aug 03 05:20:39.708229 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Accept-Encoding: identity Aug 03 05:20:39.708229 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Connection: close Aug 03 05:20:39.708229 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Content-Length: 0 Aug 03 05:20:39.708229 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Content-Type: application/json Aug 03 05:20:39.708229 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Host: 10.222.0.40 Aug 03 05:20:39.708229 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Openstack-System-Scope: None Aug 03 05:20:39.708229 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: User-Agent: python-urllib3/1.26.10 Aug 03 05:20:39.708229 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Auth-Token: gAAAAABi6gPbNCCvHfrbanto4bj1-lel-2VikktM-wW8855hJ86FrqAD7dSHgfAHYeFZxZnlV85Hxb3VVAU_Fz2yzsJnIPiZHqm-1gOuzu_zWyJ2QCRYvy3NiidX8bl9ItEXjqMcGZQGLufjsSKHq1smtGRJyvYnd1iFXLObvq9wAij2WbeQdeU Aug 03 05:20:39.708229 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Domain-Id: None Aug 03 05:20:39.708229 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Domain-Name: None Aug 03 05:20:39.708229 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Identity-Status: Confirmed Aug 03 05:20:39.708229 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Is-Admin-Project: True Aug 03 05:20:39.708229 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Openstack-Nova-Api-Version: 2.20 Aug 03 05:20:39.708229 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Domain-Id: default Aug 03 05:20:39.708229 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Domain-Name: Default Aug 03 05:20:39.708229 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Id: 050592077e0b4d26a1555d2daa7f460d Aug 03 05:20:39.708229 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1717649029 Aug 03 05:20:39.708229 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Role: member,reader Aug 03 05:20:39.708229 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Roles: member,reader Aug 03 05:20:39.709869 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_050592077e0b4d26a1555d2daa7f460d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/050592077e0b4d26a1555d2daa7f460d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/050592077e0b4d26a1555d2daa7f460d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/050592077e0b4d26a1555d2daa7f460d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:20:39.709869 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1717649029 Aug 03 05:20:39.709869 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant-Id: 050592077e0b4d26a1555d2daa7f460d Aug 03 05:20:39.709869 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1717649029 Aug 03 05:20:39.709869 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User: tempest-AttachVolumeShelveTestJSON-1717649029-project Aug 03 05:20:39.709869 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Domain-Id: default Aug 03 05:20:39.709869 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Domain-Name: Default Aug 03 05:20:39.709869 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Id: 747a608061504d7693f0f99ecdfa476e Aug 03 05:20:39.709869 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1717649029-project Aug 03 05:20:39.709869 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: method: > Aug 03 05:20:39.709869 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: exception: Instance 69089938-1d69-415c-8344-e6b9f78f16d1 could not be found. Aug 03 05:20:39.709869 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: action_args: {'id': '69089938-1d69-415c-8344-e6b9f78f16d1'} Aug 03 05:20:39.710783 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:20:39.710783 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:20:39.710783 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:20:39.710783 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:20:39.710783 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:20:39.710783 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:20:39.710783 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:20:39.710783 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:20:39.710783 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:20:39.710783 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:20:39.710783 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69089938-1d69-415c-8344-e6b9f78f16d1 could not be found. Aug 03 05:20:39.710783 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:20:39.710783 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:20:39.710783 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:20:39.710783 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:20:39.710783 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:20:39.710783 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:20:39.710783 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:20:39.710783 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:20:39.710783 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:20:39.712316 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:20:39.712316 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:20:39.712316 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:20:39.712316 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:20:39.712316 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:20:39.712316 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:20:39.712316 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:20:39.712316 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69089938-1d69-415c-8344-e6b9f78f16d1 could not be found. Aug 03 05:20:39.712316 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:20:39.712316 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:20:39.712316 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:20:39.712316 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:20:39.712316 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:20:39.712316 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:20:39.712316 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:20:39.712316 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:20:39.712316 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69089938-1d69-415c-8344-e6b9f78f16d1 could not be found. Aug 03 05:20:39.712316 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:20:39.713661 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-3fdbee29-a78a-445f-8ff6-295d46b4905f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] Returning 404 to user: Instance 69089938-1d69-415c-8344-e6b9f78f16d1 could not be found. {{(pid=118332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:20:39.713661 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-3fdbee29-a78a-445f-8ff6-295d46b4905f tempest-AttachVolumeShelveTestJSON-1717649029 tempest-AttachVolumeShelveTestJSON-1717649029-project] 10.222.0.40 "GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1" status: 404 len: 111 microversion: 2.20 time: 0.032905 Aug 03 05:20:39.713661 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 435/903] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Aug 3 05:20:39 2022] GET /compute/v2.1/servers/69089938-1d69-415c-8344-e6b9f78f16d1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 05:20:44.743389 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-397f90b4-41b5-4e02-b7af-7e6ab46d0be4 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-189955740", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1057909603", "security_groups": [{"name": "tempest-secgroup-smoke-1007032199"}], "block_device_mapping_v2": [{"uuid": "15e172bc-6901-4cd0-8f2b-0df5ac25f976", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d274ff51-9652-4d23-8cbb-d03e5409ca96"}]}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:20:44.865110 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.network.neutron [None req-397f90b4-41b5-4e02-b7af-7e6ab46d0be4 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] validate_networks() for [('d274ff51-9652-4d23-8cbb-d03e5409ca96', None, None, None, None, None)] {{(pid=118331) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:20:45.399106 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-397f90b4-41b5-4e02-b7af-7e6ab46d0be4 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Flavor limits 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:20:45.399532 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-397f90b4-41b5-4e02-b7af-7e6ab46d0be4 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Image limits 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:20:45.400007 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-397f90b4-41b5-4e02-b7af-7e6ab46d0be4 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Flavor pref 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:20:45.400419 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-397f90b4-41b5-4e02-b7af-7e6ab46d0be4 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Image pref 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:20:45.400855 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-397f90b4-41b5-4e02-b7af-7e6ab46d0be4 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:20:45.413668 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-397f90b4-41b5-4e02-b7af-7e6ab46d0be4 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:45.414302 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-397f90b4-41b5-4e02-b7af-7e6ab46d0be4 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:45.415909 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-397f90b4-41b5-4e02-b7af-7e6ab46d0be4 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:45.416640 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-397f90b4-41b5-4e02-b7af-7e6ab46d0be4 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:45.438961 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-397f90b4-41b5-4e02-b7af-7e6ab46d0be4 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Getting quotas for project 3c986ef0f5ea46f9b5e788aaca042b06. Resources: {'instances', 'ram', 'cores'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:20:45.445220 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-397f90b4-41b5-4e02-b7af-7e6ab46d0be4 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Getting quotas for user ac3954ab39014ef3819111a6fe8142b7 and project 3c986ef0f5ea46f9b5e788aaca042b06. Resources: {'instances', 'ram', 'cores'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:20:45.508327 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-397f90b4-41b5-4e02-b7af-7e6ab46d0be4 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Going to run 1 instances... {{(pid=118331) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:20:45.514040 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-397f90b4-41b5-4e02-b7af-7e6ab46d0be4 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: 64b183db-1997-4a33-9bb9-40d05791a321] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='15e172bc-6901-4cd0-8f2b-0df5ac25f976',volume_size=None,volume_type=None)] {{(pid=118331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:20:45.956544 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-397f90b4-41b5-4e02-b7af-7e6ab46d0be4 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.217107 Aug 03 05:20:45.958999 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 469/904] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Aug 3 05:20:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 1220 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 05:20:45.968780 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-0e09f7cb-711e-405f-b80e-00ae2d86c178 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:20:45.969331 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-0e09f7cb-711e-405f-b80e-00ae2d86c178 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: 64b183db-1997-4a33-9bb9-40d05791a321] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:20:46.023613 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-0e09f7cb-711e-405f-b80e-00ae2d86c178 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3954ab39014ef3819111a6fe8142b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c986ef0f5ea46f9b5e788aaca042b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:20:46.030441 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-0e09f7cb-711e-405f-b80e-00ae2d86c178 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/64b183db-1997-4a33-9bb9-40d05791a321" status: 200 len: 1094 microversion: 2.1 time: 0.065509 Aug 03 05:20:46.032600 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 436/905] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:20:45 2022] GET /compute/v2.1/servers/64b183db-1997-4a33-9bb9-40d05791a321 => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:20:47.050667 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-4aa80669-9a69-4148-9f12-ade838f212d6 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:20:47.051349 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-4aa80669-9a69-4148-9f12-ade838f212d6 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: 64b183db-1997-4a33-9bb9-40d05791a321] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:20:47.058329 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4aa80669-9a69-4148-9f12-ade838f212d6 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:47.058795 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4aa80669-9a69-4148-9f12-ade838f212d6 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:47.059671 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4aa80669-9a69-4148-9f12-ade838f212d6 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:47.060111 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4aa80669-9a69-4148-9f12-ade838f212d6 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:47.137439 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-4aa80669-9a69-4148-9f12-ade838f212d6 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3954ab39014ef3819111a6fe8142b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c986ef0f5ea46f9b5e788aaca042b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:20:47.155474 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-4aa80669-9a69-4148-9f12-ade838f212d6 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/64b183db-1997-4a33-9bb9-40d05791a321" status: 200 len: 1144 microversion: 2.1 time: 0.106383 Aug 03 05:20:47.157524 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 470/906] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:20:47 2022] GET /compute/v2.1/servers/64b183db-1997-4a33-9bb9-40d05791a321 => generated 1144 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:20:48.181033 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-aa576e0e-a007-4f8b-933b-7dc9bd6ab4e9 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:20:48.181818 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-aa576e0e-a007-4f8b-933b-7dc9bd6ab4e9 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: 64b183db-1997-4a33-9bb9-40d05791a321] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:20:48.196133 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-aa576e0e-a007-4f8b-933b-7dc9bd6ab4e9 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:48.196864 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-aa576e0e-a007-4f8b-933b-7dc9bd6ab4e9 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:48.197590 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-aa576e0e-a007-4f8b-933b-7dc9bd6ab4e9 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:48.198035 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-aa576e0e-a007-4f8b-933b-7dc9bd6ab4e9 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:48.335069 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-aa576e0e-a007-4f8b-933b-7dc9bd6ab4e9 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3954ab39014ef3819111a6fe8142b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c986ef0f5ea46f9b5e788aaca042b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:20:48.342779 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-aa576e0e-a007-4f8b-933b-7dc9bd6ab4e9 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/64b183db-1997-4a33-9bb9-40d05791a321" status: 200 len: 1200 microversion: 2.1 time: 0.166710 Aug 03 05:20:48.343607 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 437/907] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:20:48 2022] GET /compute/v2.1/servers/64b183db-1997-4a33-9bb9-40d05791a321 => generated 1200 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:20:49.364685 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-6b2f1768-203b-4dfd-ab73-273ad769d457 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:20:49.365299 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-6b2f1768-203b-4dfd-ab73-273ad769d457 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: 64b183db-1997-4a33-9bb9-40d05791a321] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:20:49.372531 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6b2f1768-203b-4dfd-ab73-273ad769d457 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:49.373010 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6b2f1768-203b-4dfd-ab73-273ad769d457 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:49.373785 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6b2f1768-203b-4dfd-ab73-273ad769d457 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:49.374219 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6b2f1768-203b-4dfd-ab73-273ad769d457 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:49.470908 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-6b2f1768-203b-4dfd-ab73-273ad769d457 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3954ab39014ef3819111a6fe8142b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c986ef0f5ea46f9b5e788aaca042b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:20:49.480965 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-6b2f1768-203b-4dfd-ab73-273ad769d457 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/64b183db-1997-4a33-9bb9-40d05791a321" status: 200 len: 1210 microversion: 2.1 time: 0.120813 Aug 03 05:20:49.481665 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 471/908] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:20:49 2022] GET /compute/v2.1/servers/64b183db-1997-4a33-9bb9-40d05791a321 => generated 1210 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:20:50.513312 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-8eea7a52-a179-47a0-bd96-9c9ca71c87e5 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:20:50.514587 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-8eea7a52-a179-47a0-bd96-9c9ca71c87e5 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: 64b183db-1997-4a33-9bb9-40d05791a321] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:20:50.523441 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-8eea7a52-a179-47a0-bd96-9c9ca71c87e5 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:50.524117 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-8eea7a52-a179-47a0-bd96-9c9ca71c87e5 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:50.524914 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-8eea7a52-a179-47a0-bd96-9c9ca71c87e5 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:50.525736 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-8eea7a52-a179-47a0-bd96-9c9ca71c87e5 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:50.835723 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-8eea7a52-a179-47a0-bd96-9c9ca71c87e5 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3954ab39014ef3819111a6fe8142b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c986ef0f5ea46f9b5e788aaca042b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:20:50.843640 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-8eea7a52-a179-47a0-bd96-9c9ca71c87e5 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/64b183db-1997-4a33-9bb9-40d05791a321" status: 200 len: 1266 microversion: 2.1 time: 0.334912 Aug 03 05:20:50.858091 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 438/909] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:20:50 2022] GET /compute/v2.1/servers/64b183db-1997-4a33-9bb9-40d05791a321 => generated 1266 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:20:51.261353 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-ef489fb2-ab58-47e8-ad45-43b0d9a0573d req-b2f4f7c4-7f36-40c2-a520-b4e6e183260e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64b183db-1997-4a33-9bb9-40d05791a321", "tag": "de448b7f-132d-4efd-89d2-4ced52b96e94"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:20:51.272103 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-ef489fb2-ab58-47e8-ad45-43b0d9a0573d req-b2f4f7c4-7f36-40c2-a520-b4e6e183260e service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:51.272580 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-ef489fb2-ab58-47e8-ad45-43b0d9a0573d req-b2f4f7c4-7f36-40c2-a520-b4e6e183260e service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:51.286052 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-ef489fb2-ab58-47e8-ad45-43b0d9a0573d req-b2f4f7c4-7f36-40c2-a520-b4e6e183260e service nova] Creating event network-changed:de448b7f-132d-4efd-89d2-4ced52b96e94 for instance 64b183db-1997-4a33-9bb9-40d05791a321 on hv-cinder-85127 Aug 03 05:20:51.291407 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-ef489fb2-ab58-47e8-ad45-43b0d9a0573d req-b2f4f7c4-7f36-40c2-a520-b4e6e183260e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035720 Aug 03 05:20:51.292191 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 472/910] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:20:51.868942 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-4a75a491-4e68-46a3-a1e0-40d6b91e3a42 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:20:51.869570 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-4a75a491-4e68-46a3-a1e0-40d6b91e3a42 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: 64b183db-1997-4a33-9bb9-40d05791a321] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:20:51.884450 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-4a75a491-4e68-46a3-a1e0-40d6b91e3a42 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:51.884916 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-4a75a491-4e68-46a3-a1e0-40d6b91e3a42 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:51.886423 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-4a75a491-4e68-46a3-a1e0-40d6b91e3a42 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:51.886990 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-4a75a491-4e68-46a3-a1e0-40d6b91e3a42 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:52.540024 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-4a75a491-4e68-46a3-a1e0-40d6b91e3a42 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3954ab39014ef3819111a6fe8142b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c986ef0f5ea46f9b5e788aaca042b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:20:52.548406 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-4a75a491-4e68-46a3-a1e0-40d6b91e3a42 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/64b183db-1997-4a33-9bb9-40d05791a321" status: 200 len: 1266 microversion: 2.1 time: 0.686178 Aug 03 05:20:52.548992 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 439/911] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:20:51 2022] GET /compute/v2.1/servers/64b183db-1997-4a33-9bb9-40d05791a321 => generated 1266 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:20:53.512622 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-1c69da47-0c01-479a-a10d-d55207490d6d tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Action: 'create', calling method: .version_select at 0x7f7601f22ca0>, body: {"keypair": {"name": "tempest-keypair-1423913732", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFL2XE6RWOqoj200a1vyP/VfYinUP+e6Pnsqt5P6j6gtK0o4iRhPoq/lyYOWt1G9VrL7KLfoW9ex+pG7CeCMFt6GB2tBAGeGpJOhERdOMvBQkDaJwCTLV0dXdjef5/ikiw=="}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:20:53.528696 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-1c69da47-0c01-479a-a10d-d55207490d6d tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Getting quotas for project 041a553912c64de981d9f87b551c190f. Resources: {'key_pairs'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:20:53.533020 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-1c69da47-0c01-479a-a10d-d55207490d6d tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Getting quotas for user 729a6d00e1664a6298088e52de9999f5 and project 041a553912c64de981d9f87b551c190f. Resources: {'key_pairs'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:20:53.570195 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-0d53b8ad-e938-41c2-8d86-73295caf9672 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:20:53.570811 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-0d53b8ad-e938-41c2-8d86-73295caf9672 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: 64b183db-1997-4a33-9bb9-40d05791a321] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:20:53.577568 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-0d53b8ad-e938-41c2-8d86-73295caf9672 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:53.578027 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-0d53b8ad-e938-41c2-8d86-73295caf9672 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:53.579091 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-0d53b8ad-e938-41c2-8d86-73295caf9672 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:53.579537 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-0d53b8ad-e938-41c2-8d86-73295caf9672 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:53.614563 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-1c69da47-0c01-479a-a10d-d55207490d6d tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.324301 Aug 03 05:20:53.616183 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 473/912] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Aug 3 05:20:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:20:53.737195 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-0d53b8ad-e938-41c2-8d86-73295caf9672 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3954ab39014ef3819111a6fe8142b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c986ef0f5ea46f9b5e788aaca042b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:20:53.745780 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-0d53b8ad-e938-41c2-8d86-73295caf9672 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/64b183db-1997-4a33-9bb9-40d05791a321" status: 200 len: 1266 microversion: 2.1 time: 0.179782 Aug 03 05:20:53.746358 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 440/913] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:20:53 2022] GET /compute/v2.1/servers/64b183db-1997-4a33-9bb9-40d05791a321 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:20:54.766426 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-c283c2ca-30ba-4b14-827b-716228d946ff tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:20:54.767170 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-c283c2ca-30ba-4b14-827b-716228d946ff tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: 64b183db-1997-4a33-9bb9-40d05791a321] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:20:54.774825 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c283c2ca-30ba-4b14-827b-716228d946ff tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:54.775228 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c283c2ca-30ba-4b14-827b-716228d946ff tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:54.776006 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c283c2ca-30ba-4b14-827b-716228d946ff tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:54.776447 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c283c2ca-30ba-4b14-827b-716228d946ff tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:54.991725 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-c283c2ca-30ba-4b14-827b-716228d946ff tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3954ab39014ef3819111a6fe8142b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c986ef0f5ea46f9b5e788aaca042b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:20:54.999513 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-c283c2ca-30ba-4b14-827b-716228d946ff tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/64b183db-1997-4a33-9bb9-40d05791a321" status: 200 len: 1266 microversion: 2.1 time: 0.237432 Aug 03 05:20:55.000188 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 474/914] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:20:54 2022] GET /compute/v2.1/servers/64b183db-1997-4a33-9bb9-40d05791a321 => generated 1266 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:20:56.022350 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-f71b6e4c-6ea4-4d5a-9a85-e547b5bbcb68 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:20:56.023481 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-f71b6e4c-6ea4-4d5a-9a85-e547b5bbcb68 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: 64b183db-1997-4a33-9bb9-40d05791a321] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:20:56.025872 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:20:56.027668 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_cell0:SELECT=2 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:20:56.031394 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f71b6e4c-6ea4-4d5a-9a85-e547b5bbcb68 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:56.035669 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f71b6e4c-6ea4-4d5a-9a85-e547b5bbcb68 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:56.035669 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f71b6e4c-6ea4-4d5a-9a85-e547b5bbcb68 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:56.035669 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f71b6e4c-6ea4-4d5a-9a85-e547b5bbcb68 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:56.037192 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:20:56.062243 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-fb25e218-eccf-44fe-b70f-ffcea19854a2 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-81351716", "imageRef": "37d7ad4a-d925-48e6-84af-ec878f19050e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a2df47b9-9137-4503-88b3-7af6200f8ad6"}], "security_groups": [{"name": "tempest-securitygroup--374720537"}], "key_name": "tempest-keypair-1423913732", "user_data": "}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:20:56.074862 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell0:SELECT=2 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:20:56.205914 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.network.neutron [None req-fb25e218-eccf-44fe-b70f-ffcea19854a2 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] validate_networks() for [('a2df47b9-9137-4503-88b3-7af6200f8ad6', None, None, None, None, None)] {{(pid=118331) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:20:56.211923 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-f71b6e4c-6ea4-4d5a-9a85-e547b5bbcb68 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3954ab39014ef3819111a6fe8142b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c986ef0f5ea46f9b5e788aaca042b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:20:56.219498 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-f71b6e4c-6ea4-4d5a-9a85-e547b5bbcb68 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/64b183db-1997-4a33-9bb9-40d05791a321" status: 200 len: 1266 microversion: 2.1 time: 0.201724 Aug 03 05:20:56.220166 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 441/915] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:20:56 2022] GET /compute/v2.1/servers/64b183db-1997-4a33-9bb9-40d05791a321 => generated 1266 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:20:56.585625 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-fb25e218-eccf-44fe-b70f-ffcea19854a2 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Flavor limits 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:20:56.586060 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-fb25e218-eccf-44fe-b70f-ffcea19854a2 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Image limits 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:20:56.586559 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-fb25e218-eccf-44fe-b70f-ffcea19854a2 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Flavor pref 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:20:56.587013 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-fb25e218-eccf-44fe-b70f-ffcea19854a2 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Image pref 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:20:56.587430 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-fb25e218-eccf-44fe-b70f-ffcea19854a2 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:20:56.596198 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fb25e218-eccf-44fe-b70f-ffcea19854a2 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:56.597163 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fb25e218-eccf-44fe-b70f-ffcea19854a2 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:56.597969 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fb25e218-eccf-44fe-b70f-ffcea19854a2 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:56.598409 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fb25e218-eccf-44fe-b70f-ffcea19854a2 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:56.615384 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-fb25e218-eccf-44fe-b70f-ffcea19854a2 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Getting quotas for project 041a553912c64de981d9f87b551c190f. Resources: {'instances', 'ram', 'cores'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:20:56.619560 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-fb25e218-eccf-44fe-b70f-ffcea19854a2 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Getting quotas for user 729a6d00e1664a6298088e52de9999f5 and project 041a553912c64de981d9f87b551c190f. Resources: {'instances', 'ram', 'cores'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:20:56.632557 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-fb25e218-eccf-44fe-b70f-ffcea19854a2 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Going to run 1 instances... {{(pid=118331) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:20:56.634998 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-fb25e218-eccf-44fe-b70f-ffcea19854a2 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 29be3e63-53b2-4e8f-b006-551a1b12c8a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37d7ad4a-d925-48e6-84af-ec878f19050e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:20:56.741090 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-fb25e218-eccf-44fe-b70f-ffcea19854a2 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.683290 Aug 03 05:20:56.741740 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 475/916] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Aug 3 05:20:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 05:20:56.753040 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-b71685d7-b288-4366-b452-ec709638fb41 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:20:56.757571 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-b71685d7-b288-4366-b452-ec709638fb41 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 29be3e63-53b2-4e8f-b006-551a1b12c8a7] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:20:56.810660 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-b71685d7-b288-4366-b452-ec709638fb41 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729a6d00e1664a6298088e52de9999f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041a553912c64de981d9f87b551c190f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:20:56.818554 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-b71685d7-b288-4366-b452-ec709638fb41 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/29be3e63-53b2-4e8f-b006-551a1b12c8a7" status: 200 len: 1240 microversion: 2.1 time: 0.069746 Aug 03 05:20:56.819164 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 442/917] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:20:56 2022] GET /compute/v2.1/servers/29be3e63-53b2-4e8f-b006-551a1b12c8a7 => generated 1240 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:20:57.240945 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-bfb8058e-350e-4ee6-a5cc-cbd1a3723df1 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:20:57.241702 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-bfb8058e-350e-4ee6-a5cc-cbd1a3723df1 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: 64b183db-1997-4a33-9bb9-40d05791a321] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:20:57.250169 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bfb8058e-350e-4ee6-a5cc-cbd1a3723df1 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:57.250628 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bfb8058e-350e-4ee6-a5cc-cbd1a3723df1 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:57.251436 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bfb8058e-350e-4ee6-a5cc-cbd1a3723df1 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:57.251882 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bfb8058e-350e-4ee6-a5cc-cbd1a3723df1 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:57.421168 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-bfb8058e-350e-4ee6-a5cc-cbd1a3723df1 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3954ab39014ef3819111a6fe8142b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c986ef0f5ea46f9b5e788aaca042b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:20:57.431165 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-bfb8058e-350e-4ee6-a5cc-cbd1a3723df1 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/64b183db-1997-4a33-9bb9-40d05791a321" status: 200 len: 1266 microversion: 2.1 time: 0.194670 Aug 03 05:20:57.443671 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 476/918] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:20:57 2022] GET /compute/v2.1/servers/64b183db-1997-4a33-9bb9-40d05791a321 => generated 1266 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:20:57.840304 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-d10142b0-48e0-487e-85b6-23b0a77fdbfe tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:20:57.840905 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-d10142b0-48e0-487e-85b6-23b0a77fdbfe tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 29be3e63-53b2-4e8f-b006-551a1b12c8a7] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:20:57.847640 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-d10142b0-48e0-487e-85b6-23b0a77fdbfe tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:57.848085 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-d10142b0-48e0-487e-85b6-23b0a77fdbfe tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:57.856829 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-d10142b0-48e0-487e-85b6-23b0a77fdbfe tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:57.856829 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-d10142b0-48e0-487e-85b6-23b0a77fdbfe tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:57.910048 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-d10142b0-48e0-487e-85b6-23b0a77fdbfe tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729a6d00e1664a6298088e52de9999f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041a553912c64de981d9f87b551c190f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:20:57.917542 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-d10142b0-48e0-487e-85b6-23b0a77fdbfe tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/29be3e63-53b2-4e8f-b006-551a1b12c8a7" status: 200 len: 1244 microversion: 2.1 time: 0.081323 Aug 03 05:20:57.918050 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 443/919] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:20:57 2022] GET /compute/v2.1/servers/29be3e63-53b2-4e8f-b006-551a1b12c8a7 => generated 1244 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:20:58.453987 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-2f700aa4-7cee-460c-9176-e677613f9be1 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:20:58.458374 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-2f700aa4-7cee-460c-9176-e677613f9be1 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: 64b183db-1997-4a33-9bb9-40d05791a321] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:20:58.461524 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2f700aa4-7cee-460c-9176-e677613f9be1 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:58.461985 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2f700aa4-7cee-460c-9176-e677613f9be1 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:58.462759 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2f700aa4-7cee-460c-9176-e677613f9be1 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:58.463232 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2f700aa4-7cee-460c-9176-e677613f9be1 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:58.640103 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-2f700aa4-7cee-460c-9176-e677613f9be1 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3954ab39014ef3819111a6fe8142b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c986ef0f5ea46f9b5e788aaca042b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:20:58.650693 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-2f700aa4-7cee-460c-9176-e677613f9be1 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/64b183db-1997-4a33-9bb9-40d05791a321" status: 200 len: 1266 microversion: 2.1 time: 0.200764 Aug 03 05:20:58.651306 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 477/920] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:20:58 2022] GET /compute/v2.1/servers/64b183db-1997-4a33-9bb9-40d05791a321 => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:20:58.939112 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-681d4e19-25aa-42a4-aeea-575461091927 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:20:58.939738 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-681d4e19-25aa-42a4-aeea-575461091927 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 29be3e63-53b2-4e8f-b006-551a1b12c8a7] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:20:58.947202 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-681d4e19-25aa-42a4-aeea-575461091927 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:58.948332 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-681d4e19-25aa-42a4-aeea-575461091927 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:58.948527 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-681d4e19-25aa-42a4-aeea-575461091927 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:58.948974 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-681d4e19-25aa-42a4-aeea-575461091927 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:59.016478 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-681d4e19-25aa-42a4-aeea-575461091927 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729a6d00e1664a6298088e52de9999f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041a553912c64de981d9f87b551c190f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:20:59.024721 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-681d4e19-25aa-42a4-aeea-575461091927 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/29be3e63-53b2-4e8f-b006-551a1b12c8a7" status: 200 len: 1292 microversion: 2.1 time: 0.089486 Aug 03 05:20:59.025302 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 444/921] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:20:58 2022] GET /compute/v2.1/servers/29be3e63-53b2-4e8f-b006-551a1b12c8a7 => generated 1292 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:20:59.671698 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-838936bc-5d41-433a-9bef-b3ea0665d651 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:20:59.672362 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-838936bc-5d41-433a-9bef-b3ea0665d651 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: 64b183db-1997-4a33-9bb9-40d05791a321] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:20:59.679902 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-838936bc-5d41-433a-9bef-b3ea0665d651 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:59.680814 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-838936bc-5d41-433a-9bef-b3ea0665d651 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:59.681232 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-838936bc-5d41-433a-9bef-b3ea0665d651 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:59.681678 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-838936bc-5d41-433a-9bef-b3ea0665d651 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:59.685822 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=63 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:20:59.900987 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-838936bc-5d41-433a-9bef-b3ea0665d651 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3954ab39014ef3819111a6fe8142b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c986ef0f5ea46f9b5e788aaca042b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:20:59.908461 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-838936bc-5d41-433a-9bef-b3ea0665d651 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/64b183db-1997-4a33-9bb9-40d05791a321" status: 200 len: 1266 microversion: 2.1 time: 0.240625 Aug 03 05:20:59.911614 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 478/922] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:20:59 2022] GET /compute/v2.1/servers/64b183db-1997-4a33-9bb9-40d05791a321 => generated 1266 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:21:00.045998 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-b861f8a5-d15a-4fcf-84fb-88a77cc64eac tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:21:00.046618 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-b861f8a5-d15a-4fcf-84fb-88a77cc64eac tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 29be3e63-53b2-4e8f-b006-551a1b12c8a7] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:21:00.053115 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b861f8a5-d15a-4fcf-84fb-88a77cc64eac tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:00.053557 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b861f8a5-d15a-4fcf-84fb-88a77cc64eac tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:00.054347 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b861f8a5-d15a-4fcf-84fb-88a77cc64eac tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:00.054787 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b861f8a5-d15a-4fcf-84fb-88a77cc64eac tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:00.149565 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-b861f8a5-d15a-4fcf-84fb-88a77cc64eac tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729a6d00e1664a6298088e52de9999f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041a553912c64de981d9f87b551c190f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:21:00.157313 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-b861f8a5-d15a-4fcf-84fb-88a77cc64eac tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/29be3e63-53b2-4e8f-b006-551a1b12c8a7" status: 200 len: 1298 microversion: 2.1 time: 0.115380 Aug 03 05:21:00.158265 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 445/923] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:21:00 2022] GET /compute/v2.1/servers/29be3e63-53b2-4e8f-b006-551a1b12c8a7 => generated 1298 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:21:00.930482 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-3a2687b1-c19c-43c8-8d9a-92e2ae463a43 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:21:00.932175 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-3a2687b1-c19c-43c8-8d9a-92e2ae463a43 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: 64b183db-1997-4a33-9bb9-40d05791a321] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:21:00.936199 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=7 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:21:00.940841 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3a2687b1-c19c-43c8-8d9a-92e2ae463a43 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:00.941197 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3a2687b1-c19c-43c8-8d9a-92e2ae463a43 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:00.942377 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3a2687b1-c19c-43c8-8d9a-92e2ae463a43 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:00.943200 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3a2687b1-c19c-43c8-8d9a-92e2ae463a43 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:01.180212 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-bdba8ea9-4703-42ed-85db-b8a86580c8af tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:21:01.180784 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-bdba8ea9-4703-42ed-85db-b8a86580c8af tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 29be3e63-53b2-4e8f-b006-551a1b12c8a7] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:21:01.187542 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-bdba8ea9-4703-42ed-85db-b8a86580c8af tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:01.188001 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-bdba8ea9-4703-42ed-85db-b8a86580c8af tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:01.188780 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-bdba8ea9-4703-42ed-85db-b8a86580c8af tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:01.189223 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-bdba8ea9-4703-42ed-85db-b8a86580c8af tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:01.507074 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-bdba8ea9-4703-42ed-85db-b8a86580c8af tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729a6d00e1664a6298088e52de9999f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041a553912c64de981d9f87b551c190f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:21:01.515537 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-bdba8ea9-4703-42ed-85db-b8a86580c8af tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/29be3e63-53b2-4e8f-b006-551a1b12c8a7" status: 200 len: 1365 microversion: 2.1 time: 0.339102 Aug 03 05:21:01.516172 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 446/924] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:21:01 2022] GET /compute/v2.1/servers/29be3e63-53b2-4e8f-b006-551a1b12c8a7 => generated 1365 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:21:01.525859 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-3a2687b1-c19c-43c8-8d9a-92e2ae463a43 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3954ab39014ef3819111a6fe8142b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c986ef0f5ea46f9b5e788aaca042b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:21:01.534676 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-3a2687b1-c19c-43c8-8d9a-92e2ae463a43 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/64b183db-1997-4a33-9bb9-40d05791a321" status: 200 len: 1266 microversion: 2.1 time: 0.607906 Aug 03 05:21:01.535329 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 479/925] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:21:00 2022] GET /compute/v2.1/servers/64b183db-1997-4a33-9bb9-40d05791a321 => generated 1266 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:21:01.945815 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [req-f7b75719-2c91-435f-8ba8-eda448263b05 req-3d1601da-d426-4101-bc54-53291fc83e65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29be3e63-53b2-4e8f-b006-551a1b12c8a7", "tag": "2c501039-721c-4570-98a9-38350b4fa0bc"}]} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:21:01.956903 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-f7b75719-2c91-435f-8ba8-eda448263b05 req-3d1601da-d426-4101-bc54-53291fc83e65 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:01.957233 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-f7b75719-2c91-435f-8ba8-eda448263b05 req-3d1601da-d426-4101-bc54-53291fc83e65 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:01.968328 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.compute.server_external_events [req-f7b75719-2c91-435f-8ba8-eda448263b05 req-3d1601da-d426-4101-bc54-53291fc83e65 service nova] Creating event network-changed:2c501039-721c-4570-98a9-38350b4fa0bc for instance 29be3e63-53b2-4e8f-b006-551a1b12c8a7 on hv-cinder-85127 Aug 03 05:21:01.975313 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [req-f7b75719-2c91-435f-8ba8-eda448263b05 req-3d1601da-d426-4101-bc54-53291fc83e65 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035801 Aug 03 05:21:01.976054 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 447/926] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:21:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:21:02.536196 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-af4fef7a-592a-4dbf-90a6-52fe385cc2ce tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:21:02.536793 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-af4fef7a-592a-4dbf-90a6-52fe385cc2ce tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 29be3e63-53b2-4e8f-b006-551a1b12c8a7] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:21:02.543346 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-af4fef7a-592a-4dbf-90a6-52fe385cc2ce tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:02.543798 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-af4fef7a-592a-4dbf-90a6-52fe385cc2ce tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:02.544569 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-af4fef7a-592a-4dbf-90a6-52fe385cc2ce tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:02.545008 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-af4fef7a-592a-4dbf-90a6-52fe385cc2ce tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:02.556960 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-34ce99a2-95fd-41e2-931e-d282c6a8bc8f tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:21:02.557568 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-34ce99a2-95fd-41e2-931e-d282c6a8bc8f tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: 64b183db-1997-4a33-9bb9-40d05791a321] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:21:02.564934 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-34ce99a2-95fd-41e2-931e-d282c6a8bc8f tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:02.566166 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-34ce99a2-95fd-41e2-931e-d282c6a8bc8f tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:02.567636 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-34ce99a2-95fd-41e2-931e-d282c6a8bc8f tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:02.568287 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-34ce99a2-95fd-41e2-931e-d282c6a8bc8f tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:02.824952 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-af4fef7a-592a-4dbf-90a6-52fe385cc2ce tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729a6d00e1664a6298088e52de9999f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041a553912c64de981d9f87b551c190f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:21:02.832723 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-af4fef7a-592a-4dbf-90a6-52fe385cc2ce tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/29be3e63-53b2-4e8f-b006-551a1b12c8a7" status: 200 len: 1365 microversion: 2.1 time: 0.300676 Aug 03 05:21:02.833295 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 480/927] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:21:02 2022] GET /compute/v2.1/servers/29be3e63-53b2-4e8f-b006-551a1b12c8a7 => generated 1365 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:21:02.858366 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-34ce99a2-95fd-41e2-931e-d282c6a8bc8f tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3954ab39014ef3819111a6fe8142b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c986ef0f5ea46f9b5e788aaca042b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:21:02.866941 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-34ce99a2-95fd-41e2-931e-d282c6a8bc8f tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/64b183db-1997-4a33-9bb9-40d05791a321" status: 200 len: 1266 microversion: 2.1 time: 0.315016 Aug 03 05:21:02.867518 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 448/928] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:21:02 2022] GET /compute/v2.1/servers/64b183db-1997-4a33-9bb9-40d05791a321 => generated 1266 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:21:03.855146 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-5ba42497-2dff-44de-aae7-3778b460816e tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:21:03.856634 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-5ba42497-2dff-44de-aae7-3778b460816e tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 29be3e63-53b2-4e8f-b006-551a1b12c8a7] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:21:03.864094 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5ba42497-2dff-44de-aae7-3778b460816e tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:03.867013 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5ba42497-2dff-44de-aae7-3778b460816e tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:03.867013 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5ba42497-2dff-44de-aae7-3778b460816e tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:03.867013 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5ba42497-2dff-44de-aae7-3778b460816e tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:03.891454 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-dbbf634a-14fb-4024-a5bc-9005e4d23384 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:21:03.892885 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-dbbf634a-14fb-4024-a5bc-9005e4d23384 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: 64b183db-1997-4a33-9bb9-40d05791a321] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:21:03.901070 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-dbbf634a-14fb-4024-a5bc-9005e4d23384 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:03.901661 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-dbbf634a-14fb-4024-a5bc-9005e4d23384 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:03.902484 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-dbbf634a-14fb-4024-a5bc-9005e4d23384 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:03.903022 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-dbbf634a-14fb-4024-a5bc-9005e4d23384 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:04.089561 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-5ba42497-2dff-44de-aae7-3778b460816e tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729a6d00e1664a6298088e52de9999f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041a553912c64de981d9f87b551c190f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:21:04.093141 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-dbbf634a-14fb-4024-a5bc-9005e4d23384 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3954ab39014ef3819111a6fe8142b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c986ef0f5ea46f9b5e788aaca042b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:21:04.098943 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-5ba42497-2dff-44de-aae7-3778b460816e tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/29be3e63-53b2-4e8f-b006-551a1b12c8a7" status: 200 len: 1365 microversion: 2.1 time: 0.249012 Aug 03 05:21:04.102242 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 481/929] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:21:03 2022] GET /compute/v2.1/servers/29be3e63-53b2-4e8f-b006-551a1b12c8a7 => generated 1365 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:21:04.102374 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-dbbf634a-14fb-4024-a5bc-9005e4d23384 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/64b183db-1997-4a33-9bb9-40d05791a321" status: 200 len: 1266 microversion: 2.1 time: 0.215873 Aug 03 05:21:04.102374 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 449/930] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:21:03 2022] GET /compute/v2.1/servers/64b183db-1997-4a33-9bb9-40d05791a321 => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:21:04.104618 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-0d5e672c-e2cc-438f-b3c4-92dac657d499 req-e8417c7c-a776-446e-b735-accb01848773 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64b183db-1997-4a33-9bb9-40d05791a321", "name": "network-vif-plugged", "status": "completed", "tag": "de448b7f-132d-4efd-89d2-4ced52b96e94"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:21:04.114877 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-0d5e672c-e2cc-438f-b3c4-92dac657d499 req-e8417c7c-a776-446e-b735-accb01848773 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:04.115332 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-0d5e672c-e2cc-438f-b3c4-92dac657d499 req-e8417c7c-a776-446e-b735-accb01848773 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:04.126354 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-0d5e672c-e2cc-438f-b3c4-92dac657d499 req-e8417c7c-a776-446e-b735-accb01848773 service nova] Creating event network-vif-plugged:de448b7f-132d-4efd-89d2-4ced52b96e94 for instance 64b183db-1997-4a33-9bb9-40d05791a321 on hv-cinder-85127 Aug 03 05:21:04.131452 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-0d5e672c-e2cc-438f-b3c4-92dac657d499 req-e8417c7c-a776-446e-b735-accb01848773 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030683 Aug 03 05:21:04.132039 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 482/931] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:21:05.120364 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-f91423a5-6bfe-4d68-b119-cd62f11751b4 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:21:05.120974 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-f91423a5-6bfe-4d68-b119-cd62f11751b4 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 29be3e63-53b2-4e8f-b006-551a1b12c8a7] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:21:05.122771 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-6adb724b-632b-42fd-a289-9d7a4f4a7aeb tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:21:05.123516 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-6adb724b-632b-42fd-a289-9d7a4f4a7aeb tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: 64b183db-1997-4a33-9bb9-40d05791a321] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:21:05.127710 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f91423a5-6bfe-4d68-b119-cd62f11751b4 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:05.128211 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f91423a5-6bfe-4d68-b119-cd62f11751b4 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:05.129567 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f91423a5-6bfe-4d68-b119-cd62f11751b4 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:05.130009 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f91423a5-6bfe-4d68-b119-cd62f11751b4 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:05.130487 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6adb724b-632b-42fd-a289-9d7a4f4a7aeb tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:05.130981 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6adb724b-632b-42fd-a289-9d7a4f4a7aeb tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:05.131760 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6adb724b-632b-42fd-a289-9d7a4f4a7aeb tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:05.132205 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6adb724b-632b-42fd-a289-9d7a4f4a7aeb tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:05.326561 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-f91423a5-6bfe-4d68-b119-cd62f11751b4 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729a6d00e1664a6298088e52de9999f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041a553912c64de981d9f87b551c190f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:21:05.331263 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-6adb724b-632b-42fd-a289-9d7a4f4a7aeb tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3954ab39014ef3819111a6fe8142b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c986ef0f5ea46f9b5e788aaca042b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:21:05.334417 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-f91423a5-6bfe-4d68-b119-cd62f11751b4 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/29be3e63-53b2-4e8f-b006-551a1b12c8a7" status: 200 len: 1365 microversion: 2.1 time: 0.218012 Aug 03 05:21:05.335016 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 450/932] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:21:05 2022] GET /compute/v2.1/servers/29be3e63-53b2-4e8f-b006-551a1b12c8a7 => generated 1365 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:21:05.340345 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-6adb724b-632b-42fd-a289-9d7a4f4a7aeb tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/64b183db-1997-4a33-9bb9-40d05791a321" status: 200 len: 1266 microversion: 2.1 time: 0.222061 Aug 03 05:21:05.341091 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 483/933] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:21:05 2022] GET /compute/v2.1/servers/64b183db-1997-4a33-9bb9-40d05791a321 => generated 1266 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:21:06.147514 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [req-f4dc8f29-4887-40bb-8a3c-87d00a08963a req-2c2c79a4-01fd-4aa0-9c7b-b20522dfbb23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29be3e63-53b2-4e8f-b006-551a1b12c8a7", "name": "network-vif-plugged", "status": "completed", "tag": "2c501039-721c-4570-98a9-38350b4fa0bc"}]} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:21:06.157047 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-f4dc8f29-4887-40bb-8a3c-87d00a08963a req-2c2c79a4-01fd-4aa0-9c7b-b20522dfbb23 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:06.157498 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-f4dc8f29-4887-40bb-8a3c-87d00a08963a req-2c2c79a4-01fd-4aa0-9c7b-b20522dfbb23 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:06.170792 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.compute.server_external_events [req-f4dc8f29-4887-40bb-8a3c-87d00a08963a req-2c2c79a4-01fd-4aa0-9c7b-b20522dfbb23 service nova] Creating event network-vif-plugged:2c501039-721c-4570-98a9-38350b4fa0bc for instance 29be3e63-53b2-4e8f-b006-551a1b12c8a7 on hv-cinder-85127 Aug 03 05:21:06.175616 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [req-f4dc8f29-4887-40bb-8a3c-87d00a08963a req-2c2c79a4-01fd-4aa0-9c7b-b20522dfbb23 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032619 Aug 03 05:21:06.176195 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 451/934] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:21:06.356349 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-bb23c3dc-0791-4936-9d7f-2b3bdb493105 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:21:06.357097 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-bb23c3dc-0791-4936-9d7f-2b3bdb493105 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 29be3e63-53b2-4e8f-b006-551a1b12c8a7] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:21:06.361076 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-c5ba7872-6dac-47c3-96df-5501218434a6 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:21:06.366377 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-c5ba7872-6dac-47c3-96df-5501218434a6 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: 64b183db-1997-4a33-9bb9-40d05791a321] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:21:06.366522 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bb23c3dc-0791-4936-9d7f-2b3bdb493105 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:06.366522 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bb23c3dc-0791-4936-9d7f-2b3bdb493105 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:06.366522 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bb23c3dc-0791-4936-9d7f-2b3bdb493105 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:06.366522 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bb23c3dc-0791-4936-9d7f-2b3bdb493105 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:06.367956 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-c5ba7872-6dac-47c3-96df-5501218434a6 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:06.368414 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-c5ba7872-6dac-47c3-96df-5501218434a6 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:06.369189 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-c5ba7872-6dac-47c3-96df-5501218434a6 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:06.369631 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-c5ba7872-6dac-47c3-96df-5501218434a6 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:06.568307 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-bb23c3dc-0791-4936-9d7f-2b3bdb493105 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729a6d00e1664a6298088e52de9999f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041a553912c64de981d9f87b551c190f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:21:06.571973 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-c5ba7872-6dac-47c3-96df-5501218434a6 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3954ab39014ef3819111a6fe8142b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c986ef0f5ea46f9b5e788aaca042b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:21:06.575806 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-bb23c3dc-0791-4936-9d7f-2b3bdb493105 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/29be3e63-53b2-4e8f-b006-551a1b12c8a7" status: 200 len: 1365 microversion: 2.1 time: 0.223379 Aug 03 05:21:06.576386 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 484/935] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:21:06 2022] GET /compute/v2.1/servers/29be3e63-53b2-4e8f-b006-551a1b12c8a7 => generated 1365 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:21:06.579958 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-c5ba7872-6dac-47c3-96df-5501218434a6 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/64b183db-1997-4a33-9bb9-40d05791a321" status: 200 len: 1454 microversion: 2.1 time: 0.223026 Aug 03 05:21:06.580680 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 452/936] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:21:06 2022] GET /compute/v2.1/servers/64b183db-1997-4a33-9bb9-40d05791a321 => generated 1454 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:21:06.600019 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-4368ac0c-5b6b-4a52-ac2b-06aed9fb7b46 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:21:06.600630 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-4368ac0c-5b6b-4a52-ac2b-06aed9fb7b46 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: 64b183db-1997-4a33-9bb9-40d05791a321] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:21:06.605487 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell0:SELECT=2 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:21:06.607425 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4368ac0c-5b6b-4a52-ac2b-06aed9fb7b46 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:06.607825 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4368ac0c-5b6b-4a52-ac2b-06aed9fb7b46 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:06.608597 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4368ac0c-5b6b-4a52-ac2b-06aed9fb7b46 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:06.609040 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4368ac0c-5b6b-4a52-ac2b-06aed9fb7b46 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:06.628817 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell0:SELECT=16 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:21:06.742659 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-4368ac0c-5b6b-4a52-ac2b-06aed9fb7b46 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3954ab39014ef3819111a6fe8142b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c986ef0f5ea46f9b5e788aaca042b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:21:06.750340 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-4368ac0c-5b6b-4a52-ac2b-06aed9fb7b46 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/64b183db-1997-4a33-9bb9-40d05791a321" status: 200 len: 1454 microversion: 2.1 time: 0.154049 Aug 03 05:21:06.750946 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 485/937] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:21:06 2022] GET /compute/v2.1/servers/64b183db-1997-4a33-9bb9-40d05791a321 => generated 1454 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:21:07.604514 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-972b6683-dee5-435f-93b1-f4aa6f1779e2 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:21:07.604514 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-972b6683-dee5-435f-93b1-f4aa6f1779e2 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 29be3e63-53b2-4e8f-b006-551a1b12c8a7] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:21:07.606032 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_cell0:SELECT=2 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:21:07.617775 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-972b6683-dee5-435f-93b1-f4aa6f1779e2 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:07.618514 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-972b6683-dee5-435f-93b1-f4aa6f1779e2 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:07.620648 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-972b6683-dee5-435f-93b1-f4aa6f1779e2 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:07.621254 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-972b6683-dee5-435f-93b1-f4aa6f1779e2 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:07.890360 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-972b6683-dee5-435f-93b1-f4aa6f1779e2 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729a6d00e1664a6298088e52de9999f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041a553912c64de981d9f87b551c190f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:21:07.899182 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-972b6683-dee5-435f-93b1-f4aa6f1779e2 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/29be3e63-53b2-4e8f-b006-551a1b12c8a7" status: 200 len: 1365 microversion: 2.1 time: 0.304241 Aug 03 05:21:07.899867 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 453/938] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:21:07 2022] GET /compute/v2.1/servers/29be3e63-53b2-4e8f-b006-551a1b12c8a7 => generated 1365 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:21:08.271318 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-e6ec4528-5829-40a4-a2a9-fc8c0d165ab1 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:21:08.271903 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-e6ec4528-5829-40a4-a2a9-fc8c0d165ab1 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:21:08.278330 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [req-9604fc8d-39fd-460a-bdcf-819a3c6e154d req-40240c8d-8c54-4f53-84af-2bc927507d50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0", "tag": "255ebc2e-922a-4b85-be40-f642cc2ae298"}]} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:21:08.287891 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e6ec4528-5829-40a4-a2a9-fc8c0d165ab1 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:08.288354 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e6ec4528-5829-40a4-a2a9-fc8c0d165ab1 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:08.293244 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-9604fc8d-39fd-460a-bdcf-819a3c6e154d req-40240c8d-8c54-4f53-84af-2bc927507d50 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:08.293700 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-9604fc8d-39fd-460a-bdcf-819a3c6e154d req-40240c8d-8c54-4f53-84af-2bc927507d50 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:08.296966 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e6ec4528-5829-40a4-a2a9-fc8c0d165ab1 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:08.297417 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e6ec4528-5829-40a4-a2a9-fc8c0d165ab1 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:08.311635 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.compute.server_external_events [req-9604fc8d-39fd-460a-bdcf-819a3c6e154d req-40240c8d-8c54-4f53-84af-2bc927507d50 service nova] Creating event network-changed:255ebc2e-922a-4b85-be40-f642cc2ae298 for instance b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 on hv-cinder-85127 Aug 03 05:21:08.316671 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [req-9604fc8d-39fd-460a-bdcf-819a3c6e154d req-40240c8d-8c54-4f53-84af-2bc927507d50 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041882 Aug 03 05:21:08.318048 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 454/939] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:21:08.325914 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-e6ec4528-5829-40a4-a2a9-fc8c0d165ab1 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Going to try to terminate instance {{(pid=118331) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:21:08.628740 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-e6ec4528-5829-40a4-a2a9-fc8c0d165ab1 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 204 len: 0 microversion: 2.1 time: 0.361748 Aug 03 05:21:08.630709 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 486/940] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Aug 3 05:21:08 2022] DELETE /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:21:08.640099 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-8a5b7e74-c604-4118-9e68-2353fd12a42b tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:21:08.641623 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-8a5b7e74-c604-4118-9e68-2353fd12a42b tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:21:08.650620 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-8a5b7e74-c604-4118-9e68-2353fd12a42b tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:08.651416 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-8a5b7e74-c604-4118-9e68-2353fd12a42b tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:08.652513 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-8a5b7e74-c604-4118-9e68-2353fd12a42b tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:08.653127 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-8a5b7e74-c604-4118-9e68-2353fd12a42b tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:08.921708 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-12b4e10a-03f0-4445-924e-27779cbcb035 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:21:08.922691 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-12b4e10a-03f0-4445-924e-27779cbcb035 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 29be3e63-53b2-4e8f-b006-551a1b12c8a7] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:21:08.929885 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-12b4e10a-03f0-4445-924e-27779cbcb035 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:08.930143 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-8a5b7e74-c604-4118-9e68-2353fd12a42b tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:21:08.930775 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-12b4e10a-03f0-4445-924e-27779cbcb035 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:08.931755 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-12b4e10a-03f0-4445-924e-27779cbcb035 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:08.932366 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-12b4e10a-03f0-4445-924e-27779cbcb035 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:08.942678 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-8a5b7e74-c604-4118-9e68-2353fd12a42b tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1568 microversion: 2.1 time: 0.307671 Aug 03 05:21:08.943618 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 455/941] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:21:08 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1568 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:21:09.145002 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-12b4e10a-03f0-4445-924e-27779cbcb035 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729a6d00e1664a6298088e52de9999f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041a553912c64de981d9f87b551c190f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:21:09.153746 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-12b4e10a-03f0-4445-924e-27779cbcb035 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/29be3e63-53b2-4e8f-b006-551a1b12c8a7" status: 200 len: 1365 microversion: 2.1 time: 0.236271 Aug 03 05:21:09.154896 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 487/942] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:21:08 2022] GET /compute/v2.1/servers/29be3e63-53b2-4e8f-b006-551a1b12c8a7 => generated 1365 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:21:09.357471 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [req-d1531286-7683-4c49-8ba7-90da8006b133 req-5daf1ff6-f8e7-4af5-83c8-7a91e3560141 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64b183db-1997-4a33-9bb9-40d05791a321", "tag": "de448b7f-132d-4efd-89d2-4ced52b96e94"}]} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:21:09.366767 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-d1531286-7683-4c49-8ba7-90da8006b133 req-5daf1ff6-f8e7-4af5-83c8-7a91e3560141 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:09.367241 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-d1531286-7683-4c49-8ba7-90da8006b133 req-5daf1ff6-f8e7-4af5-83c8-7a91e3560141 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:09.379511 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.compute.server_external_events [req-d1531286-7683-4c49-8ba7-90da8006b133 req-5daf1ff6-f8e7-4af5-83c8-7a91e3560141 service nova] Creating event network-changed:de448b7f-132d-4efd-89d2-4ced52b96e94 for instance 64b183db-1997-4a33-9bb9-40d05791a321 on hv-cinder-85127 Aug 03 05:21:09.386297 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [req-d1531286-7683-4c49-8ba7-90da8006b133 req-5daf1ff6-f8e7-4af5-83c8-7a91e3560141 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032152 Aug 03 05:21:09.387044 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 456/943] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:21:09.964078 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-1fd12bdb-8a8a-4d99-890b-863ecd8bb6aa tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:21:09.968593 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-1fd12bdb-8a8a-4d99-890b-863ecd8bb6aa tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:21:09.972701 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1fd12bdb-8a8a-4d99-890b-863ecd8bb6aa tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:09.973492 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1fd12bdb-8a8a-4d99-890b-863ecd8bb6aa tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:09.975775 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1fd12bdb-8a8a-4d99-890b-863ecd8bb6aa tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:09.976537 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1fd12bdb-8a8a-4d99-890b-863ecd8bb6aa tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:10.126534 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-1fd12bdb-8a8a-4d99-890b-863ecd8bb6aa tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:21:10.135373 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-1fd12bdb-8a8a-4d99-890b-863ecd8bb6aa tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1568 microversion: 2.1 time: 0.175044 Aug 03 05:21:10.135968 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 488/944] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:21:09 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:21:10.177515 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-83ef53c5-51de-4e04-95ee-c10f62020017 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:21:10.178248 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-83ef53c5-51de-4e04-95ee-c10f62020017 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 29be3e63-53b2-4e8f-b006-551a1b12c8a7] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:21:10.184783 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-83ef53c5-51de-4e04-95ee-c10f62020017 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:10.185243 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-83ef53c5-51de-4e04-95ee-c10f62020017 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:10.186022 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-83ef53c5-51de-4e04-95ee-c10f62020017 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:10.186466 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-83ef53c5-51de-4e04-95ee-c10f62020017 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:10.632154 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-83ef53c5-51de-4e04-95ee-c10f62020017 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729a6d00e1664a6298088e52de9999f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041a553912c64de981d9f87b551c190f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:21:10.639581 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-83ef53c5-51de-4e04-95ee-c10f62020017 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/29be3e63-53b2-4e8f-b006-551a1b12c8a7" status: 200 len: 1365 microversion: 2.1 time: 0.467542 Aug 03 05:21:10.653319 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 457/945] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:21:10 2022] GET /compute/v2.1/servers/29be3e63-53b2-4e8f-b006-551a1b12c8a7 => generated 1365 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:21:11.157723 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-8accb7e5-592a-4723-b100-23ec6e87543d tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:21:11.158375 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-8accb7e5-592a-4723-b100-23ec6e87543d tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:21:11.166455 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8accb7e5-592a-4723-b100-23ec6e87543d tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:11.166948 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8accb7e5-592a-4723-b100-23ec6e87543d tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:11.167725 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8accb7e5-592a-4723-b100-23ec6e87543d tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:11.168162 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8accb7e5-592a-4723-b100-23ec6e87543d tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:11.373379 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-8accb7e5-592a-4723-b100-23ec6e87543d tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:21:11.380866 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-8accb7e5-592a-4723-b100-23ec6e87543d tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1449 microversion: 2.1 time: 0.227218 Aug 03 05:21:11.389958 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 489/946] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:21:11 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1449 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:21:11.616343 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [req-9a54aac9-5099-4c3f-9f3a-72406e712c30 req-e000bded-2368-4aa5-912b-95cefc724e88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0", "name": "network-vif-deleted", "tag": "255ebc2e-922a-4b85-be40-f642cc2ae298"}]} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:21:11.628481 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-9a54aac9-5099-4c3f-9f3a-72406e712c30 req-e000bded-2368-4aa5-912b-95cefc724e88 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:11.629010 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-9a54aac9-5099-4c3f-9f3a-72406e712c30 req-e000bded-2368-4aa5-912b-95cefc724e88 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:11.642906 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.compute.server_external_events [req-9a54aac9-5099-4c3f-9f3a-72406e712c30 req-e000bded-2368-4aa5-912b-95cefc724e88 service nova] Creating event network-vif-deleted:255ebc2e-922a-4b85-be40-f642cc2ae298 for instance b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 on hv-cinder-85127 Aug 03 05:21:11.650531 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [req-9a54aac9-5099-4c3f-9f3a-72406e712c30 req-e000bded-2368-4aa5-912b-95cefc724e88 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038069 Aug 03 05:21:11.651193 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 458/947] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:21:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:21:11.667803 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-3643e1c1-7aef-4c50-9eb3-74f24668e2fe tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:21:11.668694 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-3643e1c1-7aef-4c50-9eb3-74f24668e2fe tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 29be3e63-53b2-4e8f-b006-551a1b12c8a7] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:21:11.675897 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3643e1c1-7aef-4c50-9eb3-74f24668e2fe tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:11.676480 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3643e1c1-7aef-4c50-9eb3-74f24668e2fe tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:11.676993 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3643e1c1-7aef-4c50-9eb3-74f24668e2fe tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:11.677443 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3643e1c1-7aef-4c50-9eb3-74f24668e2fe tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:11.830208 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-3643e1c1-7aef-4c50-9eb3-74f24668e2fe tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729a6d00e1664a6298088e52de9999f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041a553912c64de981d9f87b551c190f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:21:11.838354 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-3643e1c1-7aef-4c50-9eb3-74f24668e2fe tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/29be3e63-53b2-4e8f-b006-551a1b12c8a7" status: 200 len: 1553 microversion: 2.1 time: 0.181222 Aug 03 05:21:11.838949 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 490/948] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:21:11 2022] GET /compute/v2.1/servers/29be3e63-53b2-4e8f-b006-551a1b12c8a7 => generated 1553 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:21:11.862355 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-4065dac5-26c3-49bc-812b-ced3856fb6aa tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:21:11.862967 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-4065dac5-26c3-49bc-812b-ced3856fb6aa tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 29be3e63-53b2-4e8f-b006-551a1b12c8a7] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:21:11.871198 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-4065dac5-26c3-49bc-812b-ced3856fb6aa tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:11.871198 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-4065dac5-26c3-49bc-812b-ced3856fb6aa tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:11.871198 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-4065dac5-26c3-49bc-812b-ced3856fb6aa tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:11.871546 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-4065dac5-26c3-49bc-812b-ced3856fb6aa tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:11.957646 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-4065dac5-26c3-49bc-812b-ced3856fb6aa tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/29be3e63-53b2-4e8f-b006-551a1b12c8a7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099448 Aug 03 05:21:11.959214 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 459/949] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Aug 3 05:21:11 2022] GET /compute/v2.1/servers/29be3e63-53b2-4e8f-b006-551a1b12c8a7/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:21:12.403196 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-b2ed358c-8c0e-4705-9586-e3ada48765e2 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:21:12.403963 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-b2ed358c-8c0e-4705-9586-e3ada48765e2 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:21:12.415621 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b2ed358c-8c0e-4705-9586-e3ada48765e2 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:12.417207 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b2ed358c-8c0e-4705-9586-e3ada48765e2 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:12.418262 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b2ed358c-8c0e-4705-9586-e3ada48765e2 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:12.419052 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b2ed358c-8c0e-4705-9586-e3ada48765e2 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:12.461078 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b2ed358c-8c0e-4705-9586-e3ada48765e2 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:12.461628 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b2ed358c-8c0e-4705-9586-e3ada48765e2 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:12.462163 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.objects.instance [None req-b2ed358c-8c0e-4705-9586-e3ada48765e2 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lazy-loading 'fault' on Instance uuid b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 {{(pid=118331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:21:12.504158 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-b2ed358c-8c0e-4705-9586-e3ada48765e2 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f145cffb3c4d4965a35553b95b316f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ff6f2c611f44256a7d85a8d99981d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:21:12.512033 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-b2ed358c-8c0e-4705-9586-e3ada48765e2 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 200 len: 1225 microversion: 2.1 time: 0.113654 Aug 03 05:21:12.512608 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 491/950] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:21:12 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 1225 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:21:13.011686 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [req-62bb024c-20d4-41f2-810c-7297ae217dfa req-5f73d0bd-9863-48cf-baa2-0ddd8f906aa8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29be3e63-53b2-4e8f-b006-551a1b12c8a7", "tag": "2c501039-721c-4570-98a9-38350b4fa0bc"}]} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:21:13.021999 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-62bb024c-20d4-41f2-810c-7297ae217dfa req-5f73d0bd-9863-48cf-baa2-0ddd8f906aa8 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:13.022455 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-62bb024c-20d4-41f2-810c-7297ae217dfa req-5f73d0bd-9863-48cf-baa2-0ddd8f906aa8 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:13.035629 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.compute.server_external_events [req-62bb024c-20d4-41f2-810c-7297ae217dfa req-5f73d0bd-9863-48cf-baa2-0ddd8f906aa8 service nova] Creating event network-changed:2c501039-721c-4570-98a9-38350b4fa0bc for instance 29be3e63-53b2-4e8f-b006-551a1b12c8a7 on hv-cinder-85127 Aug 03 05:21:13.041254 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [req-62bb024c-20d4-41f2-810c-7297ae217dfa req-5f73d0bd-9863-48cf-baa2-0ddd8f906aa8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033799 Aug 03 05:21:13.048584 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 460/951] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:21:13.540743 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-c0390718-c466-48eb-b124-f86880d0bdd1 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:21:13.544892 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-c0390718-c466-48eb-b124-f86880d0bdd1 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] [instance: b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:21:13.556715 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c0390718-c466-48eb-b124-f86880d0bdd1 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:13.557608 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c0390718-c466-48eb-b124-f86880d0bdd1 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:13.558616 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c0390718-c466-48eb-b124-f86880d0bdd1 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:13.559255 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c0390718-c466-48eb-b124-f86880d0bdd1 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:13.591217 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.wsgi [None req-c0390718-c466-48eb-b124-f86880d0bdd1 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] HTTP exception thrown: Instance b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 could not be found. Aug 03 05:21:13.593895 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-c0390718-c466-48eb-b124-f86880d0bdd1 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Request method failure captured: Aug 03 05:21:13.593895 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: request: GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 HTTP/1.1 Aug 03 05:21:13.593895 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Accept: application/json Aug 03 05:21:13.593895 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Accept-Encoding: identity Aug 03 05:21:13.593895 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Connection: close Aug 03 05:21:13.593895 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Content-Length: 0 Aug 03 05:21:13.593895 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Content-Type: application/json Aug 03 05:21:13.593895 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Host: 10.222.0.40 Aug 03 05:21:13.593895 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Openstack-System-Scope: None Aug 03 05:21:13.593895 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: User-Agent: python-urllib3/1.26.10 Aug 03 05:21:13.593895 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Auth-Token: gAAAAABi6gRPi7exWUpwI-Vsx5wz-ROe4CutpILBWuYI507_SFLV9dV5HY50D0sLQiX7HJf87U_DrJx8z-ePKdShqltS0RWf-zU1_xGZtdJMzamKSYlRrzMGeGtZfhdYiPWsJb7PocJVcvjF6Y7hZe-zIWuBbupMIsfKIM7Zbp3pkmNNNthEZxk Aug 03 05:21:13.593895 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Domain-Id: None Aug 03 05:21:13.593895 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Domain-Name: None Aug 03 05:21:13.593895 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Identity-Status: Confirmed Aug 03 05:21:13.593895 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Is-Admin-Project: True Aug 03 05:21:13.593895 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Domain-Id: default Aug 03 05:21:13.593895 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Domain-Name: Default Aug 03 05:21:13.593895 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Id: 6ff6f2c611f44256a7d85a8d99981d9d Aug 03 05:21:13.593895 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Name: tempest-TestShelveInstance-776023550 Aug 03 05:21:13.593895 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Role: member,reader Aug 03 05:21:13.593895 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Roles: member,reader Aug 03 05:21:13.595418 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6ff6f2c611f44256a7d85a8d99981d9d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6ff6f2c611f44256a7d85a8d99981d9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6ff6f2c611f44256a7d85a8d99981d9d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6ff6f2c611f44256a7d85a8d99981d9d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:21:13.595418 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant: tempest-TestShelveInstance-776023550 Aug 03 05:21:13.595418 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant-Id: 6ff6f2c611f44256a7d85a8d99981d9d Aug 03 05:21:13.595418 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant-Name: tempest-TestShelveInstance-776023550 Aug 03 05:21:13.595418 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User: tempest-TestShelveInstance-776023550-project Aug 03 05:21:13.595418 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Domain-Id: default Aug 03 05:21:13.595418 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Domain-Name: Default Aug 03 05:21:13.595418 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Id: f145cffb3c4d4965a35553b95b316f56 Aug 03 05:21:13.595418 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Name: tempest-TestShelveInstance-776023550-project Aug 03 05:21:13.595418 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: method: > Aug 03 05:21:13.595418 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: exception: Instance b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 could not be found. Aug 03 05:21:13.595418 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: action_args: {'id': 'b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0'} Aug 03 05:21:13.596229 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:21:13.596229 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:21:13.596229 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:21:13.596229 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:21:13.596229 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:21:13.596229 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:21:13.596229 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:21:13.596229 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:21:13.596229 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:21:13.596229 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:21:13.596229 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 could not be found. Aug 03 05:21:13.596229 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:21:13.596229 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:21:13.596229 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:21:13.596229 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:21:13.596229 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:21:13.596229 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:21:13.596229 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:21:13.596229 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:21:13.596229 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:21:13.597544 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:21:13.597544 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:21:13.597544 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:21:13.597544 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:21:13.597544 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:21:13.597544 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:21:13.597544 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:21:13.597544 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 could not be found. Aug 03 05:21:13.597544 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:21:13.597544 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:21:13.597544 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:21:13.597544 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:21:13.597544 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:21:13.597544 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:21:13.597544 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:21:13.597544 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:21:13.597544 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 could not be found. Aug 03 05:21:13.597544 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:21:13.598814 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-c0390718-c466-48eb-b124-f86880d0bdd1 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Returning 404 to user: Instance b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 could not be found. {{(pid=118331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:21:13.598814 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-c0390718-c466-48eb-b124-f86880d0bdd1 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0" status: 404 len: 111 microversion: 2.1 time: 0.064706 Aug 03 05:21:13.605458 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 492/952] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:21:13 2022] GET /compute/v2.1/servers/b433e59d-d0b3-4a48-bf87-3bfa0fdb02f0 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:21:13.934512 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-a2f45959-8131-4729-913b-8cf810adafb7 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] Calling method '.version_select at 0x7f7601c888b0>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:21:14.043165 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-a2f45959-8131-4729-913b-8cf810adafb7 tempest-TestShelveInstance-776023550 tempest-TestShelveInstance-776023550-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1654296735" status: 202 len: 0 microversion: 2.1 time: 0.114303 Aug 03 05:21:14.047441 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 461/953] 10.222.0.40 () {58 vars in 1254 bytes} [Wed Aug 3 05:21:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1654296735 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:21:56.510276 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-5a7daf64-26d0-4fd8-94d9-036f51772c86 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:21:56.510860 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-5a7daf64-26d0-4fd8-94d9-036f51772c86 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 29be3e63-53b2-4e8f-b006-551a1b12c8a7] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:21:56.512925 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:21:56.513607 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:21:56.518467 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5a7daf64-26d0-4fd8-94d9-036f51772c86 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:56.519036 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5a7daf64-26d0-4fd8-94d9-036f51772c86 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:56.523135 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5a7daf64-26d0-4fd8-94d9-036f51772c86 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:56.523135 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5a7daf64-26d0-4fd8-94d9-036f51772c86 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:56.544842 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-5a7daf64-26d0-4fd8-94d9-036f51772c86 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/29be3e63-53b2-4e8f-b006-551a1b12c8a7/ips" status: 200 len: 148 microversion: 2.1 time: 0.039284 Aug 03 05:21:56.545405 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 493/954] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Aug 3 05:21:56 2022] GET /compute/v2.1/servers/29be3e63-53b2-4e8f-b006-551a1b12c8a7/ips => generated 148 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:21:58.199708 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_cell1:SELECT=87 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:21:58.200450 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:21:58.204748 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-79a2c6b5-a52d-474f-bc15-86d77201bb1b tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "14cc2eb7-ef2c-4c64-9ca9-b320387f6880"}} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:21:58.207200 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-79a2c6b5-a52d-474f-bc15-86d77201bb1b tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 29be3e63-53b2-4e8f-b006-551a1b12c8a7] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:21:58.214629 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-79a2c6b5-a52d-474f-bc15-86d77201bb1b tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:58.214629 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-79a2c6b5-a52d-474f-bc15-86d77201bb1b tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:58.215738 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-79a2c6b5-a52d-474f-bc15-86d77201bb1b tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:58.215738 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-79a2c6b5-a52d-474f-bc15-86d77201bb1b tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:58.915217 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-79a2c6b5-a52d-474f-bc15-86d77201bb1b tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "POST /compute/v2.1/servers/29be3e63-53b2-4e8f-b006-551a1b12c8a7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.716742 Aug 03 05:21:58.915818 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 462/955] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Aug 3 05:21:58 2022] POST /compute/v2.1/servers/29be3e63-53b2-4e8f-b006-551a1b12c8a7/os-volume_attachments => generated 194 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:22:06.449691 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-fba52a53-c0bc-45fb-bea4-61081226f158 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Action: 'create', calling method: .version_select at 0x7f7601ea2a60>, body: {"keypair": {"name": "tempest-keypair-228773211", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjCWG5DEaVfZE1GiV5ElJwFoMxXXY5d2nh1V0mHzto7Bfp408/ELH5K5qPEq5HoWqTXod+ZEicbW4t1h+Bo6HVW/c4DxJZOrZNw/VV6frKWnW6nlqUKqzj7mMF9plkZhw=="}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:22:06.466462 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-fba52a53-c0bc-45fb-bea4-61081226f158 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Getting quotas for project 041a553912c64de981d9f87b551c190f. Resources: {'key_pairs'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:22:06.470233 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-fba52a53-c0bc-45fb-bea4-61081226f158 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Getting quotas for user 729a6d00e1664a6298088e52de9999f5 and project 041a553912c64de981d9f87b551c190f. Resources: {'key_pairs'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:22:06.581120 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-fba52a53-c0bc-45fb-bea4-61081226f158 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.135435 Aug 03 05:22:06.581755 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 494/956] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Aug 3 05:22:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:22:08.612631 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_api:SELECT=2 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:22:08.617252 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-125b1b1c-95cc-4a63-96d0-c95dfe634e3d tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-917473237", "imageRef": "37d7ad4a-d925-48e6-84af-ec878f19050e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a2df47b9-9137-4503-88b3-7af6200f8ad6"}], "security_groups": [{"name": "tempest-securitygroup--1313257198"}], "key_name": "tempest-keypair-228773211", "user_data": "}} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:22:08.725547 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.network.neutron [None req-125b1b1c-95cc-4a63-96d0-c95dfe634e3d tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] validate_networks() for [('a2df47b9-9137-4503-88b3-7af6200f8ad6', None, None, None, None, None)] {{(pid=118332) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:22:08.827785 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:22:09.108366 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.virt.hardware [None req-125b1b1c-95cc-4a63-96d0-c95dfe634e3d tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Flavor limits 0:0:0 {{(pid=118332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:22:09.108822 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.virt.hardware [None req-125b1b1c-95cc-4a63-96d0-c95dfe634e3d tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Image limits 0:0:0 {{(pid=118332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:22:09.109298 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.virt.hardware [None req-125b1b1c-95cc-4a63-96d0-c95dfe634e3d tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Flavor pref 0:0:0 {{(pid=118332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:22:09.109707 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.virt.hardware [None req-125b1b1c-95cc-4a63-96d0-c95dfe634e3d tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Image pref 0:0:0 {{(pid=118332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:22:09.110118 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.virt.hardware [None req-125b1b1c-95cc-4a63-96d0-c95dfe634e3d tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:22:09.119264 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-125b1b1c-95cc-4a63-96d0-c95dfe634e3d tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:22:09.119705 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-125b1b1c-95cc-4a63-96d0-c95dfe634e3d tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:22:09.120490 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-125b1b1c-95cc-4a63-96d0-c95dfe634e3d tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:22:09.120923 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-125b1b1c-95cc-4a63-96d0-c95dfe634e3d tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:22:09.137993 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.quota [None req-125b1b1c-95cc-4a63-96d0-c95dfe634e3d tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Getting quotas for project 041a553912c64de981d9f87b551c190f. Resources: {'instances', 'ram', 'cores'} {{(pid=118332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:22:09.141976 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.quota [None req-125b1b1c-95cc-4a63-96d0-c95dfe634e3d tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Getting quotas for user 729a6d00e1664a6298088e52de9999f5 and project 041a553912c64de981d9f87b551c190f. Resources: {'instances', 'ram', 'cores'} {{(pid=118332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:22:09.152893 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-125b1b1c-95cc-4a63-96d0-c95dfe634e3d tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Going to run 1 instances... {{(pid=118332) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:22:09.155293 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-125b1b1c-95cc-4a63-96d0-c95dfe634e3d tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 9f32bcc7-80dd-457b-a908-9ae46c3d923d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37d7ad4a-d925-48e6-84af-ec878f19050e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:22:09.273060 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-125b1b1c-95cc-4a63-96d0-c95dfe634e3d tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.661830 Aug 03 05:22:09.273701 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 463/957] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Aug 3 05:22:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 05:22:09.284939 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-791b4654-07bd-4e27-a9cb-bc741b3def13 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:22:09.285581 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-791b4654-07bd-4e27-a9cb-bc741b3def13 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 9f32bcc7-80dd-457b-a908-9ae46c3d923d] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:22:09.341134 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-791b4654-07bd-4e27-a9cb-bc741b3def13 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729a6d00e1664a6298088e52de9999f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041a553912c64de981d9f87b551c190f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:22:09.348877 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-791b4654-07bd-4e27-a9cb-bc741b3def13 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/9f32bcc7-80dd-457b-a908-9ae46c3d923d" status: 200 len: 1240 microversion: 2.1 time: 0.068251 Aug 03 05:22:09.349446 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 495/958] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:22:09 2022] GET /compute/v2.1/servers/9f32bcc7-80dd-457b-a908-9ae46c3d923d => generated 1240 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:22:10.371091 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-81572996-1849-4db8-ab9b-7bbcd7e18f97 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:22:10.371901 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-81572996-1849-4db8-ab9b-7bbcd7e18f97 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 9f32bcc7-80dd-457b-a908-9ae46c3d923d] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:22:10.380824 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-81572996-1849-4db8-ab9b-7bbcd7e18f97 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:22:10.380824 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-81572996-1849-4db8-ab9b-7bbcd7e18f97 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:22:10.380824 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-81572996-1849-4db8-ab9b-7bbcd7e18f97 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:22:10.381309 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-81572996-1849-4db8-ab9b-7bbcd7e18f97 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:22:10.443911 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-81572996-1849-4db8-ab9b-7bbcd7e18f97 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729a6d00e1664a6298088e52de9999f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041a553912c64de981d9f87b551c190f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:22:10.451803 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-81572996-1849-4db8-ab9b-7bbcd7e18f97 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/9f32bcc7-80dd-457b-a908-9ae46c3d923d" status: 200 len: 1244 microversion: 2.1 time: 0.085619 Aug 03 05:22:10.452366 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 464/959] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:22:10 2022] GET /compute/v2.1/servers/9f32bcc7-80dd-457b-a908-9ae46c3d923d => generated 1244 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:22:11.472108 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-45ea58e3-aefb-4f5d-92c1-64990c25c4e3 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:22:11.472792 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-45ea58e3-aefb-4f5d-92c1-64990c25c4e3 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 9f32bcc7-80dd-457b-a908-9ae46c3d923d] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:22:11.479782 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-45ea58e3-aefb-4f5d-92c1-64990c25c4e3 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:22:11.483083 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-45ea58e3-aefb-4f5d-92c1-64990c25c4e3 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:22:11.483083 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-45ea58e3-aefb-4f5d-92c1-64990c25c4e3 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:22:11.483083 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-45ea58e3-aefb-4f5d-92c1-64990c25c4e3 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:22:11.554173 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-45ea58e3-aefb-4f5d-92c1-64990c25c4e3 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729a6d00e1664a6298088e52de9999f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041a553912c64de981d9f87b551c190f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:22:11.561645 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-45ea58e3-aefb-4f5d-92c1-64990c25c4e3 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/9f32bcc7-80dd-457b-a908-9ae46c3d923d" status: 200 len: 1298 microversion: 2.1 time: 0.093441 Aug 03 05:22:11.562218 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 496/960] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:22:11 2022] GET /compute/v2.1/servers/9f32bcc7-80dd-457b-a908-9ae46c3d923d => generated 1298 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:22:12.582961 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-d5fc9af0-f983-4792-bbcf-ec9a3ea65a95 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:22:12.583580 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-d5fc9af0-f983-4792-bbcf-ec9a3ea65a95 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 9f32bcc7-80dd-457b-a908-9ae46c3d923d] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:22:12.590578 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-d5fc9af0-f983-4792-bbcf-ec9a3ea65a95 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:22:12.591076 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-d5fc9af0-f983-4792-bbcf-ec9a3ea65a95 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:22:12.591856 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-d5fc9af0-f983-4792-bbcf-ec9a3ea65a95 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:22:12.592302 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-d5fc9af0-f983-4792-bbcf-ec9a3ea65a95 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:22:12.736951 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-d5fc9af0-f983-4792-bbcf-ec9a3ea65a95 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729a6d00e1664a6298088e52de9999f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041a553912c64de981d9f87b551c190f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:22:12.746511 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-d5fc9af0-f983-4792-bbcf-ec9a3ea65a95 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/9f32bcc7-80dd-457b-a908-9ae46c3d923d" status: 200 len: 1366 microversion: 2.1 time: 0.167402 Aug 03 05:22:12.747211 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 465/961] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:22:12 2022] GET /compute/v2.1/servers/9f32bcc7-80dd-457b-a908-9ae46c3d923d => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:22:12.766267 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-2805371c-aa44-4403-94f0-83492f6ef4b0 req-cdd995bd-5a47-4893-b1bc-62b7adf8d9a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f32bcc7-80dd-457b-a908-9ae46c3d923d", "tag": "2af81846-e5c5-414b-9ce3-54fab64a02bf"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:22:12.776970 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-2805371c-aa44-4403-94f0-83492f6ef4b0 req-cdd995bd-5a47-4893-b1bc-62b7adf8d9a1 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:22:12.777415 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-2805371c-aa44-4403-94f0-83492f6ef4b0 req-cdd995bd-5a47-4893-b1bc-62b7adf8d9a1 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:22:12.788130 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-2805371c-aa44-4403-94f0-83492f6ef4b0 req-cdd995bd-5a47-4893-b1bc-62b7adf8d9a1 service nova] Creating event network-changed:2af81846-e5c5-414b-9ce3-54fab64a02bf for instance 9f32bcc7-80dd-457b-a908-9ae46c3d923d on hv-cinder-85127 Aug 03 05:22:12.793190 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-2805371c-aa44-4403-94f0-83492f6ef4b0 req-cdd995bd-5a47-4893-b1bc-62b7adf8d9a1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031767 Aug 03 05:22:12.793796 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 497/962] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:22:13.769500 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-19894c30-f5c4-4594-b320-cdd01b8c745a tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:22:13.770110 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-19894c30-f5c4-4594-b320-cdd01b8c745a tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 9f32bcc7-80dd-457b-a908-9ae46c3d923d] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:22:13.776659 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-19894c30-f5c4-4594-b320-cdd01b8c745a tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:22:13.777114 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-19894c30-f5c4-4594-b320-cdd01b8c745a tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:22:13.777878 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-19894c30-f5c4-4594-b320-cdd01b8c745a tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:22:13.778320 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-19894c30-f5c4-4594-b320-cdd01b8c745a tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:22:13.908067 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-19894c30-f5c4-4594-b320-cdd01b8c745a tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729a6d00e1664a6298088e52de9999f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041a553912c64de981d9f87b551c190f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:22:13.916053 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-19894c30-f5c4-4594-b320-cdd01b8c745a tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/9f32bcc7-80dd-457b-a908-9ae46c3d923d" status: 200 len: 1366 microversion: 2.1 time: 0.150379 Aug 03 05:22:13.916561 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 466/963] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:22:13 2022] GET /compute/v2.1/servers/9f32bcc7-80dd-457b-a908-9ae46c3d923d => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:22:14.937790 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-7608f775-9b38-477a-981f-1a338a0eb70f tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:22:14.938442 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-7608f775-9b38-477a-981f-1a338a0eb70f tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 9f32bcc7-80dd-457b-a908-9ae46c3d923d] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:22:14.945679 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7608f775-9b38-477a-981f-1a338a0eb70f tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:22:14.946135 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7608f775-9b38-477a-981f-1a338a0eb70f tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:22:14.947013 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7608f775-9b38-477a-981f-1a338a0eb70f tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:22:14.947465 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7608f775-9b38-477a-981f-1a338a0eb70f tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:22:15.076369 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-7608f775-9b38-477a-981f-1a338a0eb70f tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729a6d00e1664a6298088e52de9999f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041a553912c64de981d9f87b551c190f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:22:15.083860 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-7608f775-9b38-477a-981f-1a338a0eb70f tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/9f32bcc7-80dd-457b-a908-9ae46c3d923d" status: 200 len: 1366 microversion: 2.1 time: 0.150380 Aug 03 05:22:15.084427 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 498/964] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:22:14 2022] GET /compute/v2.1/servers/9f32bcc7-80dd-457b-a908-9ae46c3d923d => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:22:16.106990 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-5be8238a-404d-4201-a0ab-9a5b2c86042b tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:22:16.107843 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-5be8238a-404d-4201-a0ab-9a5b2c86042b tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 9f32bcc7-80dd-457b-a908-9ae46c3d923d] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:22:16.114547 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-5be8238a-404d-4201-a0ab-9a5b2c86042b tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:22:16.115114 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-5be8238a-404d-4201-a0ab-9a5b2c86042b tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:22:16.115894 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-5be8238a-404d-4201-a0ab-9a5b2c86042b tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:22:16.116336 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-5be8238a-404d-4201-a0ab-9a5b2c86042b tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:22:16.252406 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-5be8238a-404d-4201-a0ab-9a5b2c86042b tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729a6d00e1664a6298088e52de9999f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041a553912c64de981d9f87b551c190f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:22:16.262985 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-5be8238a-404d-4201-a0ab-9a5b2c86042b tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/9f32bcc7-80dd-457b-a908-9ae46c3d923d" status: 200 len: 1366 microversion: 2.1 time: 0.160287 Aug 03 05:22:16.263578 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 467/965] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:22:16 2022] GET /compute/v2.1/servers/9f32bcc7-80dd-457b-a908-9ae46c3d923d => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:22:17.285240 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-aa65225b-ea18-49ac-a647-9a730d3f8e84 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:22:17.285765 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-aa65225b-ea18-49ac-a647-9a730d3f8e84 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 9f32bcc7-80dd-457b-a908-9ae46c3d923d] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:22:17.292860 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-aa65225b-ea18-49ac-a647-9a730d3f8e84 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:22:17.293307 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-aa65225b-ea18-49ac-a647-9a730d3f8e84 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:22:17.294093 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-aa65225b-ea18-49ac-a647-9a730d3f8e84 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:22:17.294578 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-aa65225b-ea18-49ac-a647-9a730d3f8e84 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:22:17.424474 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-aa65225b-ea18-49ac-a647-9a730d3f8e84 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729a6d00e1664a6298088e52de9999f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041a553912c64de981d9f87b551c190f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:22:17.432321 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-aa65225b-ea18-49ac-a647-9a730d3f8e84 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/9f32bcc7-80dd-457b-a908-9ae46c3d923d" status: 200 len: 1366 microversion: 2.1 time: 0.151006 Aug 03 05:22:17.432896 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 499/966] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:22:17 2022] GET /compute/v2.1/servers/9f32bcc7-80dd-457b-a908-9ae46c3d923d => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:22:18.147054 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [req-18794bc7-9c04-4e3e-8f4a-198f6b967126 req-c1477e21-625d-4915-af12-2a6fa0f88c66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f32bcc7-80dd-457b-a908-9ae46c3d923d", "name": "network-vif-plugged", "status": "completed", "tag": "2af81846-e5c5-414b-9ce3-54fab64a02bf"}]} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:22:18.156934 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-18794bc7-9c04-4e3e-8f4a-198f6b967126 req-c1477e21-625d-4915-af12-2a6fa0f88c66 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:22:18.157374 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-18794bc7-9c04-4e3e-8f4a-198f6b967126 req-c1477e21-625d-4915-af12-2a6fa0f88c66 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:22:18.168022 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.compute.server_external_events [req-18794bc7-9c04-4e3e-8f4a-198f6b967126 req-c1477e21-625d-4915-af12-2a6fa0f88c66 service nova] Creating event network-vif-plugged:2af81846-e5c5-414b-9ce3-54fab64a02bf for instance 9f32bcc7-80dd-457b-a908-9ae46c3d923d on hv-cinder-85127 Aug 03 05:22:18.173262 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [req-18794bc7-9c04-4e3e-8f4a-198f6b967126 req-c1477e21-625d-4915-af12-2a6fa0f88c66 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029959 Aug 03 05:22:18.173917 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 468/967] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:22:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:22:18.453638 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-fbd4c825-b8ac-4773-96a1-aec54c0f2caa tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:22:18.454293 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-fbd4c825-b8ac-4773-96a1-aec54c0f2caa tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 9f32bcc7-80dd-457b-a908-9ae46c3d923d] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:22:18.461095 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fbd4c825-b8ac-4773-96a1-aec54c0f2caa tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:22:18.461583 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fbd4c825-b8ac-4773-96a1-aec54c0f2caa tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:22:18.462636 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fbd4c825-b8ac-4773-96a1-aec54c0f2caa tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:22:18.462762 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fbd4c825-b8ac-4773-96a1-aec54c0f2caa tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:22:18.615004 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-fbd4c825-b8ac-4773-96a1-aec54c0f2caa tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729a6d00e1664a6298088e52de9999f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041a553912c64de981d9f87b551c190f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:22:18.618044 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-fbd4c825-b8ac-4773-96a1-aec54c0f2caa tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/9f32bcc7-80dd-457b-a908-9ae46c3d923d" status: 200 len: 1366 microversion: 2.1 time: 0.168746 Aug 03 05:22:18.618616 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 500/968] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:22:18 2022] GET /compute/v2.1/servers/9f32bcc7-80dd-457b-a908-9ae46c3d923d => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:22:19.636886 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_cell0:SELECT=2 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:22:19.637672 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_cell0:SELECT=6 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:22:19.646419 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-3698b596-9bd4-4029-8f8a-8b20e3dd11cf tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:22:19.647193 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-3698b596-9bd4-4029-8f8a-8b20e3dd11cf tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 9f32bcc7-80dd-457b-a908-9ae46c3d923d] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:22:19.653453 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3698b596-9bd4-4029-8f8a-8b20e3dd11cf tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:22:19.653886 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3698b596-9bd4-4029-8f8a-8b20e3dd11cf tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:22:19.654645 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3698b596-9bd4-4029-8f8a-8b20e3dd11cf tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:22:19.655102 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3698b596-9bd4-4029-8f8a-8b20e3dd11cf tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:22:19.786047 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-3698b596-9bd4-4029-8f8a-8b20e3dd11cf tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729a6d00e1664a6298088e52de9999f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041a553912c64de981d9f87b551c190f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:22:19.793572 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-3698b596-9bd4-4029-8f8a-8b20e3dd11cf tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/9f32bcc7-80dd-457b-a908-9ae46c3d923d" status: 200 len: 1555 microversion: 2.1 time: 0.157594 Aug 03 05:22:19.794086 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 469/969] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:22:19 2022] GET /compute/v2.1/servers/9f32bcc7-80dd-457b-a908-9ae46c3d923d => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:22:19.814157 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-50c84bbc-9cbf-492c-99ef-22d8e6e3dc41 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:22:19.814645 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-50c84bbc-9cbf-492c-99ef-22d8e6e3dc41 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 9f32bcc7-80dd-457b-a908-9ae46c3d923d] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:22:19.816577 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell0:SELECT=6 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:22:19.822417 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-50c84bbc-9cbf-492c-99ef-22d8e6e3dc41 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:22:19.828677 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-50c84bbc-9cbf-492c-99ef-22d8e6e3dc41 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:22:19.828677 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-50c84bbc-9cbf-492c-99ef-22d8e6e3dc41 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:22:19.828677 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-50c84bbc-9cbf-492c-99ef-22d8e6e3dc41 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:22:19.904549 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-50c84bbc-9cbf-492c-99ef-22d8e6e3dc41 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/9f32bcc7-80dd-457b-a908-9ae46c3d923d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094266 Aug 03 05:22:19.909620 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 501/970] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Aug 3 05:22:19 2022] GET /compute/v2.1/servers/9f32bcc7-80dd-457b-a908-9ae46c3d923d/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:22:21.121618 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [req-27d1b1a7-593d-4b0a-b379-98cdaf182d6a req-384fc6dc-be17-4277-b564-c7454d29be5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f32bcc7-80dd-457b-a908-9ae46c3d923d", "tag": "2af81846-e5c5-414b-9ce3-54fab64a02bf"}]} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:22:21.132631 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-27d1b1a7-593d-4b0a-b379-98cdaf182d6a req-384fc6dc-be17-4277-b564-c7454d29be5e service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:22:21.132842 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-27d1b1a7-593d-4b0a-b379-98cdaf182d6a req-384fc6dc-be17-4277-b564-c7454d29be5e service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:22:21.143910 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.compute.server_external_events [req-27d1b1a7-593d-4b0a-b379-98cdaf182d6a req-384fc6dc-be17-4277-b564-c7454d29be5e service nova] Creating event network-changed:2af81846-e5c5-414b-9ce3-54fab64a02bf for instance 9f32bcc7-80dd-457b-a908-9ae46c3d923d on hv-cinder-85127 Aug 03 05:22:21.148865 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [req-27d1b1a7-593d-4b0a-b379-98cdaf182d6a req-384fc6dc-be17-4277-b564-c7454d29be5e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030908 Aug 03 05:22:21.149726 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 470/971] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:22:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:22:57.456375 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:22:57.457157 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=34 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:22:57.461177 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-99332944-102d-46fb-b541-febed1ac9f33 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:22:57.468401 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-99332944-102d-46fb-b541-febed1ac9f33 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 9f32bcc7-80dd-457b-a908-9ae46c3d923d] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:22:57.468401 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-99332944-102d-46fb-b541-febed1ac9f33 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:22:57.468401 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-99332944-102d-46fb-b541-febed1ac9f33 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:22:57.468803 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-99332944-102d-46fb-b541-febed1ac9f33 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:22:57.469244 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-99332944-102d-46fb-b541-febed1ac9f33 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:22:57.494030 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-99332944-102d-46fb-b541-febed1ac9f33 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/9f32bcc7-80dd-457b-a908-9ae46c3d923d/ips" status: 200 len: 148 microversion: 2.1 time: 0.038951 Aug 03 05:22:57.494666 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 502/972] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Aug 3 05:22:57 2022] GET /compute/v2.1/servers/9f32bcc7-80dd-457b-a908-9ae46c3d923d/ips => generated 148 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:22:57.504569 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:22:57.505418 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_cell1:SELECT=36 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:22:57.509931 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-0ba065c2-b901-42c5-8f27-475307bb695c tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "14cc2eb7-ef2c-4c64-9ca9-b320387f6880"}} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:22:57.512415 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-0ba065c2-b901-42c5-8f27-475307bb695c tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 9f32bcc7-80dd-457b-a908-9ae46c3d923d] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:22:57.518388 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-0ba065c2-b901-42c5-8f27-475307bb695c tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:22:57.518869 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-0ba065c2-b901-42c5-8f27-475307bb695c tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:22:57.519636 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-0ba065c2-b901-42c5-8f27-475307bb695c tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:22:57.520081 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-0ba065c2-b901-42c5-8f27-475307bb695c tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:22:57.760402 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.wsgi [None req-0ba065c2-b901-42c5-8f27-475307bb695c tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] HTTP exception thrown: Invalid volume: volume 14cc2eb7-ef2c-4c64-9ca9-b320387f6880 is already attached to instances: 29be3e63-53b2-4e8f-b006-551a1b12c8a7 Aug 03 05:22:57.762692 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-0ba065c2-b901-42c5-8f27-475307bb695c tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Request method failure captured: Aug 03 05:22:57.762692 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: request: POST /compute/v2.1/servers/9f32bcc7-80dd-457b-a908-9ae46c3d923d/os-volume_attachments HTTP/1.1 Aug 03 05:22:57.762692 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Accept: application/json Aug 03 05:22:57.762692 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Accept-Encoding: identity Aug 03 05:22:57.762692 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Connection: close Aug 03 05:22:57.762692 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Content-Length: 74 Aug 03 05:22:57.762692 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Content-Type: application/json Aug 03 05:22:57.762692 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Host: 10.222.0.40 Aug 03 05:22:57.762692 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Openstack-System-Scope: None Aug 03 05:22:57.762692 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: User-Agent: python-urllib3/1.26.10 Aug 03 05:22:57.762692 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Auth-Token: gAAAAABi6gW1r7_81Momgb9V-Pc_vaYPdWIEuBDrgd0bdt0JL5T9I4c2oaDN-tUUEDsquQZmmEtcUgaXB4e8p9ZfKilfQ3apGdtd4ucRlv8R2i8xepw63Jaug8YDHRv4HToMeBhksVOaOx18akgjOb1gnyi4ud6p4nKX_aDqks7lJc8JWWzNrtc Aug 03 05:22:57.762692 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Domain-Id: None Aug 03 05:22:57.762692 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Domain-Name: None Aug 03 05:22:57.762692 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Identity-Status: Confirmed Aug 03 05:22:57.762692 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Is-Admin-Project: True Aug 03 05:22:57.762692 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Domain-Id: default Aug 03 05:22:57.762692 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Domain-Name: Default Aug 03 05:22:57.762692 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Id: 041a553912c64de981d9f87b551c190f Aug 03 05:22:57.762692 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Name: tempest-AttachVolumeNegativeTest-1549219107 Aug 03 05:22:57.762692 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Role: member,reader Aug 03 05:22:57.762692 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Roles: member,reader Aug 03 05:22:57.764550 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_041a553912c64de981d9f87b551c190f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/041a553912c64de981d9f87b551c190f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/041a553912c64de981d9f87b551c190f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/041a553912c64de981d9f87b551c190f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:22:57.764550 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant: tempest-AttachVolumeNegativeTest-1549219107 Aug 03 05:22:57.764550 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant-Id: 041a553912c64de981d9f87b551c190f Aug 03 05:22:57.764550 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1549219107 Aug 03 05:22:57.764550 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User: tempest-AttachVolumeNegativeTest-1549219107-project Aug 03 05:22:57.764550 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Domain-Id: default Aug 03 05:22:57.764550 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Domain-Name: Default Aug 03 05:22:57.764550 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Id: 729a6d00e1664a6298088e52de9999f5 Aug 03 05:22:57.764550 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Name: tempest-AttachVolumeNegativeTest-1549219107-project Aug 03 05:22:57.764550 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Aug 03 05:22:57.764550 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: {"volumeAttachment": {"volumeId": "14cc2eb7-ef2c-4c64-9ca9-b320387f6880"}} Aug 03 05:22:57.764550 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: method: > Aug 03 05:22:57.765494 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: exception: Invalid volume: volume 14cc2eb7-ef2c-4c64-9ca9-b320387f6880 is already attached to instances: 29be3e63-53b2-4e8f-b006-551a1b12c8a7 Aug 03 05:22:57.765494 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: action_args: {'server_id': '9f32bcc7-80dd-457b-a908-9ae46c3d923d', 'body': {'volumeAttachment': {'volumeId': '14cc2eb7-ef2c-4c64-9ca9-b320387f6880'}}} Aug 03 05:22:57.765494 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:22:57.765494 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:22:57.765494 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 03 05:22:57.765494 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 03 05:22:57.765494 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 05:22:57.765494 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 05:22:57.765494 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 03 05:22:57.765494 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 05:22:57.765494 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 03 05:22:57.765494 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 03 05:22:57.765494 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 03 05:22:57.765494 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 03 05:22:57.765494 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 14cc2eb7-ef2c-4c64-9ca9-b320387f6880 is already attached to instances: 29be3e63-53b2-4e8f-b006-551a1b12c8a7 Aug 03 05:22:57.765494 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:22:57.765494 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:22:57.765494 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:22:57.765494 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:22:57.766885 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:22:57.766885 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:22:57.766885 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:22:57.766885 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:22:57.766885 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:22:57.766885 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:22:57.766885 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 05:22:57.766885 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 05:22:57.766885 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 05:22:57.766885 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 05:22:57.766885 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 05:22:57.766885 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 05:22:57.766885 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 03 05:22:57.766885 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 03 05:22:57.766885 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 14cc2eb7-ef2c-4c64-9ca9-b320387f6880 is already attached to instances: 29be3e63-53b2-4e8f-b006-551a1b12c8a7 Aug 03 05:22:57.766885 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:22:57.766885 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:22:57.766885 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:22:57.766885 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:22:57.766885 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:22:57.768475 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:22:57.768475 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:22:57.768475 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:22:57.768475 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 14cc2eb7-ef2c-4c64-9ca9-b320387f6880 is already attached to instances: 29be3e63-53b2-4e8f-b006-551a1b12c8a7 Aug 03 05:22:57.768475 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:22:57.768475 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-0ba065c2-b901-42c5-8f27-475307bb695c tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Returning 400 to user: Invalid volume: volume 14cc2eb7-ef2c-4c64-9ca9-b320387f6880 is already attached to instances: 29be3e63-53b2-4e8f-b006-551a1b12c8a7 {{(pid=118332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:22:57.768475 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-0ba065c2-b901-42c5-8f27-475307bb695c tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "POST /compute/v2.1/servers/9f32bcc7-80dd-457b-a908-9ae46c3d923d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.261338 Aug 03 05:22:57.768475 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 471/973] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Aug 3 05:22:57 2022] POST /compute/v2.1/servers/9f32bcc7-80dd-457b-a908-9ae46c3d923d/os-volume_attachments => generated 174 bytes in 263 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 05:22:57.773235 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-3bab0fa0-d733-4396-b9f2-f48f91afc50d tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:22:57.773729 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-3bab0fa0-d733-4396-b9f2-f48f91afc50d tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 9f32bcc7-80dd-457b-a908-9ae46c3d923d] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:22:57.780410 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3bab0fa0-d733-4396-b9f2-f48f91afc50d tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:22:57.780861 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3bab0fa0-d733-4396-b9f2-f48f91afc50d tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:22:57.781629 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3bab0fa0-d733-4396-b9f2-f48f91afc50d tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:22:57.782110 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3bab0fa0-d733-4396-b9f2-f48f91afc50d tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:22:57.808248 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-3bab0fa0-d733-4396-b9f2-f48f91afc50d tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 9f32bcc7-80dd-457b-a908-9ae46c3d923d] Going to try to terminate instance {{(pid=118331) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:22:57.961149 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 05:22:57.961354 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Wed Aug 3 05:22:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9f32bcc7-80dd-457b-a908-9ae46c3d923d (ip 10.222.0.40) !!! Aug 03 05:22:58.091996 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-3bab0fa0-d733-4396-b9f2-f48f91afc50d tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9f32bcc7-80dd-457b-a908-9ae46c3d923d" status: 204 len: 0 microversion: 2.1 time: 0.322557 Aug 03 05:22:58.092590 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 503/974] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Aug 3 05:22:57 2022] DELETE /compute/v2.1/servers/9f32bcc7-80dd-457b-a908-9ae46c3d923d => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:22:58.101346 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-17445a58-cac4-4f3e-bac7-c6179a6c4562 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:22:58.102053 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-17445a58-cac4-4f3e-bac7-c6179a6c4562 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 9f32bcc7-80dd-457b-a908-9ae46c3d923d] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:22:58.108129 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-17445a58-cac4-4f3e-bac7-c6179a6c4562 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:22:58.108575 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-17445a58-cac4-4f3e-bac7-c6179a6c4562 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:22:58.109336 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-17445a58-cac4-4f3e-bac7-c6179a6c4562 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:22:58.109769 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-17445a58-cac4-4f3e-bac7-c6179a6c4562 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:22:58.258784 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-17445a58-cac4-4f3e-bac7-c6179a6c4562 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729a6d00e1664a6298088e52de9999f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041a553912c64de981d9f87b551c190f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:22:58.266863 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-17445a58-cac4-4f3e-bac7-c6179a6c4562 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/9f32bcc7-80dd-457b-a908-9ae46c3d923d" status: 200 len: 1679 microversion: 2.1 time: 0.168845 Aug 03 05:22:58.267425 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 472/975] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:22:58 2022] GET /compute/v2.1/servers/9f32bcc7-80dd-457b-a908-9ae46c3d923d => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:22:59.290032 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-e4a3518c-64e4-44df-ac74-1f87e6eb85f0 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:22:59.290723 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-e4a3518c-64e4-44df-ac74-1f87e6eb85f0 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 9f32bcc7-80dd-457b-a908-9ae46c3d923d] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:22:59.298662 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e4a3518c-64e4-44df-ac74-1f87e6eb85f0 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:22:59.299151 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e4a3518c-64e4-44df-ac74-1f87e6eb85f0 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:22:59.299925 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e4a3518c-64e4-44df-ac74-1f87e6eb85f0 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:22:59.300397 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e4a3518c-64e4-44df-ac74-1f87e6eb85f0 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:22:59.620576 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-e4a3518c-64e4-44df-ac74-1f87e6eb85f0 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729a6d00e1664a6298088e52de9999f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041a553912c64de981d9f87b551c190f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:22:59.628315 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-e4a3518c-64e4-44df-ac74-1f87e6eb85f0 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/9f32bcc7-80dd-457b-a908-9ae46c3d923d" status: 200 len: 1679 microversion: 2.1 time: 0.342460 Aug 03 05:22:59.629073 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 504/976] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:22:59 2022] GET /compute/v2.1/servers/9f32bcc7-80dd-457b-a908-9ae46c3d923d => generated 1679 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:23:00.346317 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [req-cbcba110-d485-4330-b069-0c83fd1551b1 req-efdbf530-65ec-4b7c-b4f1-91d94711f4e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f32bcc7-80dd-457b-a908-9ae46c3d923d", "name": "network-vif-deleted", "tag": "2af81846-e5c5-414b-9ce3-54fab64a02bf"}]} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:23:00.357949 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-cbcba110-d485-4330-b069-0c83fd1551b1 req-efdbf530-65ec-4b7c-b4f1-91d94711f4e3 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:00.367831 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-cbcba110-d485-4330-b069-0c83fd1551b1 req-efdbf530-65ec-4b7c-b4f1-91d94711f4e3 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:00.370930 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.compute.server_external_events [req-cbcba110-d485-4330-b069-0c83fd1551b1 req-efdbf530-65ec-4b7c-b4f1-91d94711f4e3 service nova] Creating event network-vif-deleted:2af81846-e5c5-414b-9ce3-54fab64a02bf for instance 9f32bcc7-80dd-457b-a908-9ae46c3d923d on hv-cinder-85127 Aug 03 05:23:00.376160 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [req-cbcba110-d485-4330-b069-0c83fd1551b1 req-efdbf530-65ec-4b7c-b4f1-91d94711f4e3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034193 Aug 03 05:23:00.376853 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 473/977] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:23:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:23:00.649783 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-eacc4838-1dcd-458d-b465-71f0538ef85b tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:00.650981 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-eacc4838-1dcd-458d-b465-71f0538ef85b tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 9f32bcc7-80dd-457b-a908-9ae46c3d923d] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:00.657440 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-eacc4838-1dcd-458d-b465-71f0538ef85b tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:00.657898 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-eacc4838-1dcd-458d-b465-71f0538ef85b tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:00.658682 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-eacc4838-1dcd-458d-b465-71f0538ef85b tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:00.659176 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-eacc4838-1dcd-458d-b465-71f0538ef85b tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:00.691854 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-eacc4838-1dcd-458d-b465-71f0538ef85b tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:00.692311 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-eacc4838-1dcd-458d-b465-71f0538ef85b tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:00.692771 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.objects.instance [None req-eacc4838-1dcd-458d-b465-71f0538ef85b tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lazy-loading 'fault' on Instance uuid 9f32bcc7-80dd-457b-a908-9ae46c3d923d {{(pid=118331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:23:00.733875 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-eacc4838-1dcd-458d-b465-71f0538ef85b tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729a6d00e1664a6298088e52de9999f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041a553912c64de981d9f87b551c190f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:23:00.741991 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-eacc4838-1dcd-458d-b465-71f0538ef85b tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/9f32bcc7-80dd-457b-a908-9ae46c3d923d" status: 200 len: 1330 microversion: 2.1 time: 0.096433 Aug 03 05:23:00.742573 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 505/978] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:00 2022] GET /compute/v2.1/servers/9f32bcc7-80dd-457b-a908-9ae46c3d923d => generated 1330 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:23:01.764982 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-bd6da640-6230-4e17-83d3-b09ee07b799c tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:01.765686 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-bd6da640-6230-4e17-83d3-b09ee07b799c tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 9f32bcc7-80dd-457b-a908-9ae46c3d923d] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:01.771957 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-bd6da640-6230-4e17-83d3-b09ee07b799c tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:01.772416 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-bd6da640-6230-4e17-83d3-b09ee07b799c tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:01.773190 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-bd6da640-6230-4e17-83d3-b09ee07b799c tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:01.773637 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-bd6da640-6230-4e17-83d3-b09ee07b799c tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:01.787529 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.wsgi [None req-bd6da640-6230-4e17-83d3-b09ee07b799c tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] HTTP exception thrown: Instance 9f32bcc7-80dd-457b-a908-9ae46c3d923d could not be found. Aug 03 05:23:01.789192 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-bd6da640-6230-4e17-83d3-b09ee07b799c tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Request method failure captured: Aug 03 05:23:01.789192 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: request: GET /compute/v2.1/servers/9f32bcc7-80dd-457b-a908-9ae46c3d923d HTTP/1.1 Aug 03 05:23:01.789192 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Accept: application/json Aug 03 05:23:01.789192 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Accept-Encoding: identity Aug 03 05:23:01.789192 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Connection: close Aug 03 05:23:01.789192 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Content-Length: 0 Aug 03 05:23:01.789192 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Content-Type: application/json Aug 03 05:23:01.789192 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Host: 10.222.0.40 Aug 03 05:23:01.789192 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Openstack-System-Scope: None Aug 03 05:23:01.789192 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: User-Agent: python-urllib3/1.26.10 Aug 03 05:23:01.789192 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Auth-Token: gAAAAABi6gW1r7_81Momgb9V-Pc_vaYPdWIEuBDrgd0bdt0JL5T9I4c2oaDN-tUUEDsquQZmmEtcUgaXB4e8p9ZfKilfQ3apGdtd4ucRlv8R2i8xepw63Jaug8YDHRv4HToMeBhksVOaOx18akgjOb1gnyi4ud6p4nKX_aDqks7lJc8JWWzNrtc Aug 03 05:23:01.789192 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Domain-Id: None Aug 03 05:23:01.789192 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Domain-Name: None Aug 03 05:23:01.789192 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Identity-Status: Confirmed Aug 03 05:23:01.789192 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Is-Admin-Project: True Aug 03 05:23:01.789192 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Domain-Id: default Aug 03 05:23:01.789192 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Domain-Name: Default Aug 03 05:23:01.789192 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Id: 041a553912c64de981d9f87b551c190f Aug 03 05:23:01.789192 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Name: tempest-AttachVolumeNegativeTest-1549219107 Aug 03 05:23:01.789192 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Role: member,reader Aug 03 05:23:01.789192 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Roles: member,reader Aug 03 05:23:01.790896 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_041a553912c64de981d9f87b551c190f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/041a553912c64de981d9f87b551c190f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/041a553912c64de981d9f87b551c190f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/041a553912c64de981d9f87b551c190f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:23:01.790896 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant: tempest-AttachVolumeNegativeTest-1549219107 Aug 03 05:23:01.790896 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant-Id: 041a553912c64de981d9f87b551c190f Aug 03 05:23:01.790896 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1549219107 Aug 03 05:23:01.790896 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User: tempest-AttachVolumeNegativeTest-1549219107-project Aug 03 05:23:01.790896 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Domain-Id: default Aug 03 05:23:01.790896 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Domain-Name: Default Aug 03 05:23:01.790896 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Id: 729a6d00e1664a6298088e52de9999f5 Aug 03 05:23:01.790896 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Name: tempest-AttachVolumeNegativeTest-1549219107-project Aug 03 05:23:01.790896 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: method: > Aug 03 05:23:01.790896 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: exception: Instance 9f32bcc7-80dd-457b-a908-9ae46c3d923d could not be found. Aug 03 05:23:01.790896 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: action_args: {'id': '9f32bcc7-80dd-457b-a908-9ae46c3d923d'} Aug 03 05:23:01.791855 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:23:01.791855 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:23:01.791855 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:23:01.791855 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:23:01.791855 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:23:01.791855 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:23:01.791855 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:23:01.791855 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:23:01.791855 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:23:01.791855 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:23:01.791855 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f32bcc7-80dd-457b-a908-9ae46c3d923d could not be found. Aug 03 05:23:01.791855 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:23:01.791855 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:23:01.791855 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:23:01.791855 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:23:01.791855 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:23:01.791855 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:23:01.791855 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:23:01.791855 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:23:01.791855 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:23:01.793190 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:23:01.793190 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:23:01.793190 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:23:01.793190 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:23:01.793190 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:23:01.793190 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:23:01.793190 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:23:01.793190 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f32bcc7-80dd-457b-a908-9ae46c3d923d could not be found. Aug 03 05:23:01.793190 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:23:01.793190 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:23:01.793190 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:23:01.793190 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:23:01.793190 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:23:01.793190 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:23:01.793190 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:23:01.793190 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:23:01.793190 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f32bcc7-80dd-457b-a908-9ae46c3d923d could not be found. Aug 03 05:23:01.793190 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:23:01.794502 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-bd6da640-6230-4e17-83d3-b09ee07b799c tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Returning 404 to user: Instance 9f32bcc7-80dd-457b-a908-9ae46c3d923d could not be found. {{(pid=118332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:23:01.794502 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-bd6da640-6230-4e17-83d3-b09ee07b799c tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/9f32bcc7-80dd-457b-a908-9ae46c3d923d" status: 404 len: 111 microversion: 2.1 time: 0.030327 Aug 03 05:23:01.794502 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 474/979] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:01 2022] GET /compute/v2.1/servers/9f32bcc7-80dd-457b-a908-9ae46c3d923d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:23:01.800628 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-804b590c-2516-430d-8f85-4440e9aef8bf tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '.version_select at 0x7f7601e7b790>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:01.864313 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-804b590c-2516-430d-8f85-4440e9aef8bf tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-228773211" status: 202 len: 0 microversion: 2.1 time: 0.068497 Aug 03 05:23:01.864908 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 506/980] 10.222.0.40 () {58 vars in 1218 bytes} [Wed Aug 3 05:23:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-228773211 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:23:02.623841 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-b11363f3-b96a-49ba-8bd6-5d412d48adc1 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:02.624338 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-b11363f3-b96a-49ba-8bd6-5d412d48adc1 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 29be3e63-53b2-4e8f-b006-551a1b12c8a7] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:02.630834 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b11363f3-b96a-49ba-8bd6-5d412d48adc1 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:02.631325 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b11363f3-b96a-49ba-8bd6-5d412d48adc1 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:02.632089 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b11363f3-b96a-49ba-8bd6-5d412d48adc1 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:02.632535 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-b11363f3-b96a-49ba-8bd6-5d412d48adc1 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:02.723259 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.objects.instance [None req-b11363f3-b96a-49ba-8bd6-5d412d48adc1 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lazy-loading 'services' on Instance uuid 29be3e63-53b2-4e8f-b006-551a1b12c8a7 {{(pid=118332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:23:02.919515 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-b11363f3-b96a-49ba-8bd6-5d412d48adc1 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "DELETE /compute/v2.1/servers/29be3e63-53b2-4e8f-b006-551a1b12c8a7/os-volume_attachments/14cc2eb7-ef2c-4c64-9ca9-b320387f6880" status: 202 len: 0 microversion: 2.1 time: 0.299429 Aug 03 05:23:02.920209 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 475/981] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Aug 3 05:23:02 2022] DELETE /compute/v2.1/servers/29be3e63-53b2-4e8f-b006-551a1b12c8a7/os-volume_attachments/14cc2eb7-ef2c-4c64-9ca9-b320387f6880 => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:23:02.929868 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-ef48e2ad-1d09-4f55-8b5f-2478dec6e46e tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:02.932053 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-ef48e2ad-1d09-4f55-8b5f-2478dec6e46e tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 29be3e63-53b2-4e8f-b006-551a1b12c8a7] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:02.939485 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ef48e2ad-1d09-4f55-8b5f-2478dec6e46e tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:02.944452 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ef48e2ad-1d09-4f55-8b5f-2478dec6e46e tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:02.944452 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ef48e2ad-1d09-4f55-8b5f-2478dec6e46e tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:02.944452 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ef48e2ad-1d09-4f55-8b5f-2478dec6e46e tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:02.969622 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-ef48e2ad-1d09-4f55-8b5f-2478dec6e46e tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/29be3e63-53b2-4e8f-b006-551a1b12c8a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044409 Aug 03 05:23:02.970182 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 507/982] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Aug 3 05:23:02 2022] GET /compute/v2.1/servers/29be3e63-53b2-4e8f-b006-551a1b12c8a7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:23:03.983185 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-33e191e4-3527-4ae8-9dc6-b43e61aa7f63 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:03.985437 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-33e191e4-3527-4ae8-9dc6-b43e61aa7f63 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 29be3e63-53b2-4e8f-b006-551a1b12c8a7] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:03.992409 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-33e191e4-3527-4ae8-9dc6-b43e61aa7f63 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:03.996357 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-33e191e4-3527-4ae8-9dc6-b43e61aa7f63 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:03.996357 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-33e191e4-3527-4ae8-9dc6-b43e61aa7f63 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:03.996357 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-33e191e4-3527-4ae8-9dc6-b43e61aa7f63 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:04.022096 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-33e191e4-3527-4ae8-9dc6-b43e61aa7f63 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/29be3e63-53b2-4e8f-b006-551a1b12c8a7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043854 Aug 03 05:23:04.024903 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 476/983] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Aug 3 05:23:03 2022] GET /compute/v2.1/servers/29be3e63-53b2-4e8f-b006-551a1b12c8a7/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 05:23:04.083541 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-b3aa897b-ebf2-487b-a8e1-02a76f5d1e34 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:04.088093 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-b3aa897b-ebf2-487b-a8e1-02a76f5d1e34 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 29be3e63-53b2-4e8f-b006-551a1b12c8a7] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:04.090589 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b3aa897b-ebf2-487b-a8e1-02a76f5d1e34 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:04.091073 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b3aa897b-ebf2-487b-a8e1-02a76f5d1e34 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:04.091833 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b3aa897b-ebf2-487b-a8e1-02a76f5d1e34 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:04.092273 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b3aa897b-ebf2-487b-a8e1-02a76f5d1e34 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:04.118128 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-b3aa897b-ebf2-487b-a8e1-02a76f5d1e34 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 29be3e63-53b2-4e8f-b006-551a1b12c8a7] Going to try to terminate instance {{(pid=118331) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:23:04.365762 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-b3aa897b-ebf2-487b-a8e1-02a76f5d1e34 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "DELETE /compute/v2.1/servers/29be3e63-53b2-4e8f-b006-551a1b12c8a7" status: 204 len: 0 microversion: 2.1 time: 0.285689 Aug 03 05:23:04.366383 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 508/984] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Aug 3 05:23:04 2022] DELETE /compute/v2.1/servers/29be3e63-53b2-4e8f-b006-551a1b12c8a7 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:23:04.374657 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-0be9cf4a-ef02-4d62-abaa-6e3ca06c0f0e tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:04.378101 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-0be9cf4a-ef02-4d62-abaa-6e3ca06c0f0e tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 29be3e63-53b2-4e8f-b006-551a1b12c8a7] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:04.381916 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-0be9cf4a-ef02-4d62-abaa-6e3ca06c0f0e tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:04.382367 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-0be9cf4a-ef02-4d62-abaa-6e3ca06c0f0e tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:04.383226 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-0be9cf4a-ef02-4d62-abaa-6e3ca06c0f0e tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:04.383812 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-0be9cf4a-ef02-4d62-abaa-6e3ca06c0f0e tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:04.512712 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-0be9cf4a-ef02-4d62-abaa-6e3ca06c0f0e tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729a6d00e1664a6298088e52de9999f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041a553912c64de981d9f87b551c190f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:23:04.520633 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-0be9cf4a-ef02-4d62-abaa-6e3ca06c0f0e tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/29be3e63-53b2-4e8f-b006-551a1b12c8a7" status: 200 len: 1678 microversion: 2.1 time: 0.149907 Aug 03 05:23:04.521200 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 477/985] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:04 2022] GET /compute/v2.1/servers/29be3e63-53b2-4e8f-b006-551a1b12c8a7 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:23:05.543533 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-f847fffc-4302-49a7-acee-4742a66ab382 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:05.544258 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-f847fffc-4302-49a7-acee-4742a66ab382 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 29be3e63-53b2-4e8f-b006-551a1b12c8a7] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:05.551025 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f847fffc-4302-49a7-acee-4742a66ab382 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:05.551486 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f847fffc-4302-49a7-acee-4742a66ab382 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:05.552271 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f847fffc-4302-49a7-acee-4742a66ab382 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:05.552716 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f847fffc-4302-49a7-acee-4742a66ab382 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:05.690235 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-f847fffc-4302-49a7-acee-4742a66ab382 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729a6d00e1664a6298088e52de9999f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041a553912c64de981d9f87b551c190f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:23:05.698231 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-f847fffc-4302-49a7-acee-4742a66ab382 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/29be3e63-53b2-4e8f-b006-551a1b12c8a7" status: 200 len: 1678 microversion: 2.1 time: 0.159633 Aug 03 05:23:05.698789 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 509/986] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:05 2022] GET /compute/v2.1/servers/29be3e63-53b2-4e8f-b006-551a1b12c8a7 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:23:06.719187 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-80d8911f-f11a-469f-8ca9-00ccff6aa272 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:06.720326 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-80d8911f-f11a-469f-8ca9-00ccff6aa272 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 29be3e63-53b2-4e8f-b006-551a1b12c8a7] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:06.728537 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-80d8911f-f11a-469f-8ca9-00ccff6aa272 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:06.729007 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-80d8911f-f11a-469f-8ca9-00ccff6aa272 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:06.729894 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-80d8911f-f11a-469f-8ca9-00ccff6aa272 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:06.730832 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-80d8911f-f11a-469f-8ca9-00ccff6aa272 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:06.739838 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-471a8041-cd74-4926-b427-3b1e00dfce1a req-81f403a7-ad20-49cd-bec9-0cbc1d4c7570 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29be3e63-53b2-4e8f-b006-551a1b12c8a7", "name": "network-vif-deleted", "tag": "2c501039-721c-4570-98a9-38350b4fa0bc"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:23:06.749965 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-471a8041-cd74-4926-b427-3b1e00dfce1a req-81f403a7-ad20-49cd-bec9-0cbc1d4c7570 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:06.750503 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-471a8041-cd74-4926-b427-3b1e00dfce1a req-81f403a7-ad20-49cd-bec9-0cbc1d4c7570 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:06.762517 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-471a8041-cd74-4926-b427-3b1e00dfce1a req-81f403a7-ad20-49cd-bec9-0cbc1d4c7570 service nova] Creating event network-vif-deleted:2c501039-721c-4570-98a9-38350b4fa0bc for instance 29be3e63-53b2-4e8f-b006-551a1b12c8a7 on hv-cinder-85127 Aug 03 05:23:06.767457 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-471a8041-cd74-4926-b427-3b1e00dfce1a req-81f403a7-ad20-49cd-bec9-0cbc1d4c7570 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033390 Aug 03 05:23:06.768049 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 510/987] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:23:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:23:06.802868 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-80d8911f-f11a-469f-8ca9-00ccff6aa272 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729a6d00e1664a6298088e52de9999f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041a553912c64de981d9f87b551c190f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:23:06.811476 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-80d8911f-f11a-469f-8ca9-00ccff6aa272 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/29be3e63-53b2-4e8f-b006-551a1b12c8a7" status: 200 len: 1611 microversion: 2.1 time: 0.095991 Aug 03 05:23:06.812121 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 478/988] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:06 2022] GET /compute/v2.1/servers/29be3e63-53b2-4e8f-b006-551a1b12c8a7 => generated 1611 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:23:07.834351 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-be5cccb9-07f8-474b-b348-95bce5e7a83b tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:07.835085 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-be5cccb9-07f8-474b-b348-95bce5e7a83b tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 29be3e63-53b2-4e8f-b006-551a1b12c8a7] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:07.841957 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-be5cccb9-07f8-474b-b348-95bce5e7a83b tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:07.842408 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-be5cccb9-07f8-474b-b348-95bce5e7a83b tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:07.843206 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-be5cccb9-07f8-474b-b348-95bce5e7a83b tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:07.843653 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-be5cccb9-07f8-474b-b348-95bce5e7a83b tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:07.857053 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.wsgi [None req-be5cccb9-07f8-474b-b348-95bce5e7a83b tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] HTTP exception thrown: Instance 29be3e63-53b2-4e8f-b006-551a1b12c8a7 could not be found. Aug 03 05:23:07.858656 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-be5cccb9-07f8-474b-b348-95bce5e7a83b tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Request method failure captured: Aug 03 05:23:07.858656 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: request: GET /compute/v2.1/servers/29be3e63-53b2-4e8f-b006-551a1b12c8a7 HTTP/1.1 Aug 03 05:23:07.858656 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Accept: application/json Aug 03 05:23:07.858656 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Accept-Encoding: identity Aug 03 05:23:07.858656 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Connection: close Aug 03 05:23:07.858656 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Content-Length: 0 Aug 03 05:23:07.858656 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Content-Type: application/json Aug 03 05:23:07.858656 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Host: 10.222.0.40 Aug 03 05:23:07.858656 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Openstack-System-Scope: None Aug 03 05:23:07.858656 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: User-Agent: python-urllib3/1.26.10 Aug 03 05:23:07.858656 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Auth-Token: gAAAAABi6gW1r7_81Momgb9V-Pc_vaYPdWIEuBDrgd0bdt0JL5T9I4c2oaDN-tUUEDsquQZmmEtcUgaXB4e8p9ZfKilfQ3apGdtd4ucRlv8R2i8xepw63Jaug8YDHRv4HToMeBhksVOaOx18akgjOb1gnyi4ud6p4nKX_aDqks7lJc8JWWzNrtc Aug 03 05:23:07.858656 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Domain-Id: None Aug 03 05:23:07.858656 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Domain-Name: None Aug 03 05:23:07.858656 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Identity-Status: Confirmed Aug 03 05:23:07.858656 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Is-Admin-Project: True Aug 03 05:23:07.858656 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Domain-Id: default Aug 03 05:23:07.858656 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Domain-Name: Default Aug 03 05:23:07.858656 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Id: 041a553912c64de981d9f87b551c190f Aug 03 05:23:07.858656 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Name: tempest-AttachVolumeNegativeTest-1549219107 Aug 03 05:23:07.858656 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Role: member,reader Aug 03 05:23:07.858656 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Roles: member,reader Aug 03 05:23:07.861017 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_041a553912c64de981d9f87b551c190f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/041a553912c64de981d9f87b551c190f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/041a553912c64de981d9f87b551c190f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/041a553912c64de981d9f87b551c190f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:23:07.861017 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant: tempest-AttachVolumeNegativeTest-1549219107 Aug 03 05:23:07.861017 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant-Id: 041a553912c64de981d9f87b551c190f Aug 03 05:23:07.861017 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1549219107 Aug 03 05:23:07.861017 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User: tempest-AttachVolumeNegativeTest-1549219107-project Aug 03 05:23:07.861017 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Domain-Id: default Aug 03 05:23:07.861017 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Domain-Name: Default Aug 03 05:23:07.861017 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Id: 729a6d00e1664a6298088e52de9999f5 Aug 03 05:23:07.861017 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Name: tempest-AttachVolumeNegativeTest-1549219107-project Aug 03 05:23:07.861017 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: method: > Aug 03 05:23:07.861017 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: exception: Instance 29be3e63-53b2-4e8f-b006-551a1b12c8a7 could not be found. Aug 03 05:23:07.861017 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: action_args: {'id': '29be3e63-53b2-4e8f-b006-551a1b12c8a7'} Aug 03 05:23:07.861867 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:23:07.861867 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:23:07.861867 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:23:07.861867 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:23:07.861867 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:23:07.861867 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:23:07.861867 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:23:07.861867 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:23:07.861867 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:23:07.861867 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:23:07.861867 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29be3e63-53b2-4e8f-b006-551a1b12c8a7 could not be found. Aug 03 05:23:07.861867 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:23:07.861867 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:23:07.861867 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:23:07.861867 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:23:07.861867 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:23:07.861867 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:23:07.861867 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:23:07.861867 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:23:07.861867 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:23:07.863164 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:23:07.863164 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:23:07.863164 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:23:07.863164 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:23:07.863164 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:23:07.863164 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:23:07.863164 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:23:07.863164 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29be3e63-53b2-4e8f-b006-551a1b12c8a7 could not be found. Aug 03 05:23:07.863164 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:23:07.863164 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:23:07.863164 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:23:07.863164 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:23:07.863164 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:23:07.863164 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:23:07.863164 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:23:07.863164 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:23:07.863164 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29be3e63-53b2-4e8f-b006-551a1b12c8a7 could not be found. Aug 03 05:23:07.863164 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:23:07.864565 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-be5cccb9-07f8-474b-b348-95bce5e7a83b tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Returning 404 to user: Instance 29be3e63-53b2-4e8f-b006-551a1b12c8a7 could not be found. {{(pid=118331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:23:07.864565 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-be5cccb9-07f8-474b-b348-95bce5e7a83b tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/29be3e63-53b2-4e8f-b006-551a1b12c8a7" status: 404 len: 111 microversion: 2.1 time: 0.030031 Aug 03 05:23:07.864565 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 511/989] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:07 2022] GET /compute/v2.1/servers/29be3e63-53b2-4e8f-b006-551a1b12c8a7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:23:07.869638 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-c53ab4a4-9983-4d19-974b-35e828ecd85c tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '.version_select at 0x7f7601dcf550>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:07.926791 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-c53ab4a4-9983-4d19-974b-35e828ecd85c tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1423913732" status: 202 len: 0 microversion: 2.1 time: 0.061037 Aug 03 05:23:07.927396 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 479/990] 10.222.0.40 () {58 vars in 1221 bytes} [Wed Aug 3 05:23:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1423913732 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:23:08.681009 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-90eddf7c-d3f3-4896-b4d8-962040928ca8 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Action: 'create', calling method: .version_select at 0x7f7601f6ac10>, body: {"keypair": {"name": "tempest-keypair-515031498", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBzvnVDUXFEuWaG+8oW5nYA13YFwqRg5LmCcQd8tKcRa6sGegORwtWrRTsHEa75Eufp3Zc8rJzqRjcml6TzVJ6vJ73Ae0mjPJps4bFEgilixoLBlr1KEwZbQ6WdKgrSyWg=="}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:23:08.700580 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-90eddf7c-d3f3-4896-b4d8-962040928ca8 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Getting quotas for project 041a553912c64de981d9f87b551c190f. Resources: {'key_pairs'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:23:08.704512 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-90eddf7c-d3f3-4896-b4d8-962040928ca8 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Getting quotas for user 729a6d00e1664a6298088e52de9999f5 and project 041a553912c64de981d9f87b551c190f. Resources: {'key_pairs'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:23:08.835770 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-90eddf7c-d3f3-4896-b4d8-962040928ca8 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.158650 Aug 03 05:23:08.836561 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 512/991] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Aug 3 05:23:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:23:11.018518 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-9c3eaaaa-f4f7-4168-9bb8-f8bdbee26d18 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1977951443", "imageRef": "37d7ad4a-d925-48e6-84af-ec878f19050e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a2df47b9-9137-4503-88b3-7af6200f8ad6"}], "security_groups": [{"name": "tempest-securitygroup--531866222"}], "key_name": "tempest-keypair-515031498", "user_data": "}} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:23:11.126760 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.network.neutron [None req-9c3eaaaa-f4f7-4168-9bb8-f8bdbee26d18 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] validate_networks() for [('a2df47b9-9137-4503-88b3-7af6200f8ad6', None, None, None, None, None)] {{(pid=118332) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:23:11.507192 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.virt.hardware [None req-9c3eaaaa-f4f7-4168-9bb8-f8bdbee26d18 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Flavor limits 0:0:0 {{(pid=118332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:23:11.507678 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.virt.hardware [None req-9c3eaaaa-f4f7-4168-9bb8-f8bdbee26d18 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Image limits 0:0:0 {{(pid=118332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:23:11.508158 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.virt.hardware [None req-9c3eaaaa-f4f7-4168-9bb8-f8bdbee26d18 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Flavor pref 0:0:0 {{(pid=118332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:23:11.508564 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.virt.hardware [None req-9c3eaaaa-f4f7-4168-9bb8-f8bdbee26d18 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Image pref 0:0:0 {{(pid=118332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:23:11.508969 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.virt.hardware [None req-9c3eaaaa-f4f7-4168-9bb8-f8bdbee26d18 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:23:11.518013 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-9c3eaaaa-f4f7-4168-9bb8-f8bdbee26d18 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:11.518463 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-9c3eaaaa-f4f7-4168-9bb8-f8bdbee26d18 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:11.519290 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-9c3eaaaa-f4f7-4168-9bb8-f8bdbee26d18 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:11.519730 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-9c3eaaaa-f4f7-4168-9bb8-f8bdbee26d18 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:11.536948 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.quota [None req-9c3eaaaa-f4f7-4168-9bb8-f8bdbee26d18 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Getting quotas for project 041a553912c64de981d9f87b551c190f. Resources: {'instances', 'ram', 'cores'} {{(pid=118332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:23:11.540895 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.quota [None req-9c3eaaaa-f4f7-4168-9bb8-f8bdbee26d18 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Getting quotas for user 729a6d00e1664a6298088e52de9999f5 and project 041a553912c64de981d9f87b551c190f. Resources: {'instances', 'ram', 'cores'} {{(pid=118332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:23:11.552292 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-9c3eaaaa-f4f7-4168-9bb8-f8bdbee26d18 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Going to run 1 instances... {{(pid=118332) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:23:11.554544 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-9c3eaaaa-f4f7-4168-9bb8-f8bdbee26d18 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: d6b60ff4-a76f-4b50-8e1b-2b11561286b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37d7ad4a-d925-48e6-84af-ec878f19050e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:23:11.681755 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-9c3eaaaa-f4f7-4168-9bb8-f8bdbee26d18 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.668217 Aug 03 05:23:11.682406 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 480/992] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Aug 3 05:23:11 2022] POST /compute/v2.1/servers => generated 401 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 05:23:11.693340 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-914d1f7c-2e9f-4c06-abc0-b407751cf44e tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:11.693963 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-914d1f7c-2e9f-4c06-abc0-b407751cf44e tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: d6b60ff4-a76f-4b50-8e1b-2b11561286b2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:11.755454 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-914d1f7c-2e9f-4c06-abc0-b407751cf44e tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729a6d00e1664a6298088e52de9999f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041a553912c64de981d9f87b551c190f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:23:11.763253 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-914d1f7c-2e9f-4c06-abc0-b407751cf44e tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/d6b60ff4-a76f-4b50-8e1b-2b11561286b2" status: 200 len: 1241 microversion: 2.1 time: 0.073865 Aug 03 05:23:11.763817 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 513/993] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:11 2022] GET /compute/v2.1/servers/d6b60ff4-a76f-4b50-8e1b-2b11561286b2 => generated 1241 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:23:12.785178 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-3e8b6f26-7358-4bcd-b006-40dee24b6fc1 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:12.785856 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-3e8b6f26-7358-4bcd-b006-40dee24b6fc1 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: d6b60ff4-a76f-4b50-8e1b-2b11561286b2] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:12.792936 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3e8b6f26-7358-4bcd-b006-40dee24b6fc1 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:12.793387 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3e8b6f26-7358-4bcd-b006-40dee24b6fc1 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:12.794158 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3e8b6f26-7358-4bcd-b006-40dee24b6fc1 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:12.794620 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3e8b6f26-7358-4bcd-b006-40dee24b6fc1 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:12.858460 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-3e8b6f26-7358-4bcd-b006-40dee24b6fc1 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729a6d00e1664a6298088e52de9999f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041a553912c64de981d9f87b551c190f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:23:12.865956 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-3e8b6f26-7358-4bcd-b006-40dee24b6fc1 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/d6b60ff4-a76f-4b50-8e1b-2b11561286b2" status: 200 len: 1237 microversion: 2.1 time: 0.086018 Aug 03 05:23:12.866530 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 481/994] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:12 2022] GET /compute/v2.1/servers/d6b60ff4-a76f-4b50-8e1b-2b11561286b2 => generated 1237 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:23:12.880663 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-b732371c-b4e4-4eda-99fc-65ff4947a69c tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:12.881197 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-b732371c-b4e4-4eda-99fc-65ff4947a69c tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: 64b183db-1997-4a33-9bb9-40d05791a321] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:12.888069 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b732371c-b4e4-4eda-99fc-65ff4947a69c tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:12.888523 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b732371c-b4e4-4eda-99fc-65ff4947a69c tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:12.889331 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b732371c-b4e4-4eda-99fc-65ff4947a69c tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:12.890025 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b732371c-b4e4-4eda-99fc-65ff4947a69c tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:12.920239 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-b732371c-b4e4-4eda-99fc-65ff4947a69c tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: 64b183db-1997-4a33-9bb9-40d05791a321] Going to try to terminate instance {{(pid=118331) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:23:13.165178 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-b732371c-b4e4-4eda-99fc-65ff4947a69c tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "DELETE /compute/v2.1/servers/64b183db-1997-4a33-9bb9-40d05791a321" status: 204 len: 0 microversion: 2.1 time: 0.288227 Aug 03 05:23:13.165767 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 514/995] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Aug 3 05:23:12 2022] DELETE /compute/v2.1/servers/64b183db-1997-4a33-9bb9-40d05791a321 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:23:13.178468 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-699423cc-6160-45fb-a34c-24331783915b tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:13.178468 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-699423cc-6160-45fb-a34c-24331783915b tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: 64b183db-1997-4a33-9bb9-40d05791a321] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:13.181138 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-699423cc-6160-45fb-a34c-24331783915b tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:13.181598 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-699423cc-6160-45fb-a34c-24331783915b tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:13.182374 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-699423cc-6160-45fb-a34c-24331783915b tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:13.182821 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-699423cc-6160-45fb-a34c-24331783915b tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:13.315294 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-699423cc-6160-45fb-a34c-24331783915b tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3954ab39014ef3819111a6fe8142b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c986ef0f5ea46f9b5e788aaca042b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:23:13.323134 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-699423cc-6160-45fb-a34c-24331783915b tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/64b183db-1997-4a33-9bb9-40d05791a321" status: 200 len: 1579 microversion: 2.1 time: 0.152942 Aug 03 05:23:13.323703 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 482/996] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:13 2022] GET /compute/v2.1/servers/64b183db-1997-4a33-9bb9-40d05791a321 => generated 1579 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:23:13.887904 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-07719c94-f1c6-48be-9cb9-e301f345d262 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:13.888607 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-07719c94-f1c6-48be-9cb9-e301f345d262 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: d6b60ff4-a76f-4b50-8e1b-2b11561286b2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:13.895811 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-07719c94-f1c6-48be-9cb9-e301f345d262 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:13.896279 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-07719c94-f1c6-48be-9cb9-e301f345d262 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:13.897040 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-07719c94-f1c6-48be-9cb9-e301f345d262 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:13.897487 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-07719c94-f1c6-48be-9cb9-e301f345d262 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:13.960564 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-07719c94-f1c6-48be-9cb9-e301f345d262 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729a6d00e1664a6298088e52de9999f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041a553912c64de981d9f87b551c190f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:23:13.967902 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-07719c94-f1c6-48be-9cb9-e301f345d262 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/d6b60ff4-a76f-4b50-8e1b-2b11561286b2" status: 200 len: 1301 microversion: 2.1 time: 0.084213 Aug 03 05:23:13.968459 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 515/997] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:13 2022] GET /compute/v2.1/servers/d6b60ff4-a76f-4b50-8e1b-2b11561286b2 => generated 1301 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:23:14.344888 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-8fb09eea-63a8-4598-8a4e-ab71ba5cef10 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:14.345435 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-8fb09eea-63a8-4598-8a4e-ab71ba5cef10 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: 64b183db-1997-4a33-9bb9-40d05791a321] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:14.352928 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-8fb09eea-63a8-4598-8a4e-ab71ba5cef10 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:14.354406 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-8fb09eea-63a8-4598-8a4e-ab71ba5cef10 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:14.355643 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-8fb09eea-63a8-4598-8a4e-ab71ba5cef10 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:14.356225 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-8fb09eea-63a8-4598-8a4e-ab71ba5cef10 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:14.772226 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-8fb09eea-63a8-4598-8a4e-ab71ba5cef10 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3954ab39014ef3819111a6fe8142b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c986ef0f5ea46f9b5e788aaca042b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:23:14.785012 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-8fb09eea-63a8-4598-8a4e-ab71ba5cef10 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/64b183db-1997-4a33-9bb9-40d05791a321" status: 200 len: 1579 microversion: 2.1 time: 0.444312 Aug 03 05:23:14.785611 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 483/998] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:14 2022] GET /compute/v2.1/servers/64b183db-1997-4a33-9bb9-40d05791a321 => generated 1579 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:23:14.989994 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-1c00df5a-2409-413d-9165-968c54bafabd tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:14.990607 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-1c00df5a-2409-413d-9165-968c54bafabd tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: d6b60ff4-a76f-4b50-8e1b-2b11561286b2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:14.997260 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1c00df5a-2409-413d-9165-968c54bafabd tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:14.997712 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1c00df5a-2409-413d-9165-968c54bafabd tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:14.998485 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1c00df5a-2409-413d-9165-968c54bafabd tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:14.998965 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1c00df5a-2409-413d-9165-968c54bafabd tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:15.074080 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-1c00df5a-2409-413d-9165-968c54bafabd tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729a6d00e1664a6298088e52de9999f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041a553912c64de981d9f87b551c190f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:23:15.081513 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-1c00df5a-2409-413d-9165-968c54bafabd tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/d6b60ff4-a76f-4b50-8e1b-2b11561286b2" status: 200 len: 1299 microversion: 2.1 time: 0.095365 Aug 03 05:23:15.082078 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 516/999] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:14 2022] GET /compute/v2.1/servers/d6b60ff4-a76f-4b50-8e1b-2b11561286b2 => generated 1299 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:23:15.808187 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-26b3a392-3367-439e-ace7-47160b36c107 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:15.808988 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-26b3a392-3367-439e-ace7-47160b36c107 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: 64b183db-1997-4a33-9bb9-40d05791a321] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:15.816160 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-26b3a392-3367-439e-ace7-47160b36c107 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:15.816619 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-26b3a392-3367-439e-ace7-47160b36c107 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:15.817400 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-26b3a392-3367-439e-ace7-47160b36c107 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:15.817845 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-26b3a392-3367-439e-ace7-47160b36c107 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:15.928331 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-26b3a392-3367-439e-ace7-47160b36c107 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3954ab39014ef3819111a6fe8142b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c986ef0f5ea46f9b5e788aaca042b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:23:15.936592 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-26b3a392-3367-439e-ace7-47160b36c107 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/64b183db-1997-4a33-9bb9-40d05791a321" status: 200 len: 1511 microversion: 2.1 time: 0.132985 Aug 03 05:23:15.947678 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 484/1000] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:15 2022] GET /compute/v2.1/servers/64b183db-1997-4a33-9bb9-40d05791a321 => generated 1511 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:23:16.104669 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-c0e5a08f-d3e8-4284-9016-c988301e831c tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:16.106562 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-c0e5a08f-d3e8-4284-9016-c988301e831c tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: d6b60ff4-a76f-4b50-8e1b-2b11561286b2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:16.114075 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c0e5a08f-d3e8-4284-9016-c988301e831c tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:16.114751 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c0e5a08f-d3e8-4284-9016-c988301e831c tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:16.116266 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c0e5a08f-d3e8-4284-9016-c988301e831c tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:16.117065 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c0e5a08f-d3e8-4284-9016-c988301e831c tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:16.151628 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [req-74f4f1bc-7c47-4c90-9137-081099ad86da req-32606897-0519-431e-b882-ed419af2ab1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64b183db-1997-4a33-9bb9-40d05791a321", "name": "network-vif-deleted", "tag": "de448b7f-132d-4efd-89d2-4ced52b96e94"}]} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:23:16.166158 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-74f4f1bc-7c47-4c90-9137-081099ad86da req-32606897-0519-431e-b882-ed419af2ab1e service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:16.166621 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-74f4f1bc-7c47-4c90-9137-081099ad86da req-32606897-0519-431e-b882-ed419af2ab1e service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:16.183494 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.compute.server_external_events [req-74f4f1bc-7c47-4c90-9137-081099ad86da req-32606897-0519-431e-b882-ed419af2ab1e service nova] Creating event network-vif-deleted:de448b7f-132d-4efd-89d2-4ced52b96e94 for instance 64b183db-1997-4a33-9bb9-40d05791a321 on hv-cinder-85127 Aug 03 05:23:16.190827 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [req-74f4f1bc-7c47-4c90-9137-081099ad86da req-32606897-0519-431e-b882-ed419af2ab1e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042573 Aug 03 05:23:16.192135 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 485/1001] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:23:16.397369 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-c0e5a08f-d3e8-4284-9016-c988301e831c tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729a6d00e1664a6298088e52de9999f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041a553912c64de981d9f87b551c190f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:23:16.401193 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:23:16.405980 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-c0e5a08f-d3e8-4284-9016-c988301e831c tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/d6b60ff4-a76f-4b50-8e1b-2b11561286b2" status: 200 len: 1366 microversion: 2.1 time: 0.305850 Aug 03 05:23:16.406548 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 517/1002] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:16 2022] GET /compute/v2.1/servers/d6b60ff4-a76f-4b50-8e1b-2b11561286b2 => generated 1366 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:23:16.960572 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-ab091f8b-00c3-4ec2-9e81-28fd823496fc tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:16.964143 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-ab091f8b-00c3-4ec2-9e81-28fd823496fc tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: 64b183db-1997-4a33-9bb9-40d05791a321] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:16.985677 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-ab091f8b-00c3-4ec2-9e81-28fd823496fc tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:16.986500 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-ab091f8b-00c3-4ec2-9e81-28fd823496fc tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:16.987516 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-ab091f8b-00c3-4ec2-9e81-28fd823496fc tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:16.987961 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-ab091f8b-00c3-4ec2-9e81-28fd823496fc tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:17.026228 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-ab091f8b-00c3-4ec2-9e81-28fd823496fc tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:17.026737 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-ab091f8b-00c3-4ec2-9e81-28fd823496fc tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:17.027510 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.objects.instance [None req-ab091f8b-00c3-4ec2-9e81-28fd823496fc tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lazy-loading 'fault' on Instance uuid 64b183db-1997-4a33-9bb9-40d05791a321 {{(pid=118332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:23:17.110368 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-ab091f8b-00c3-4ec2-9e81-28fd823496fc tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3954ab39014ef3819111a6fe8142b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c986ef0f5ea46f9b5e788aaca042b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:23:17.121103 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-ab091f8b-00c3-4ec2-9e81-28fd823496fc tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/64b183db-1997-4a33-9bb9-40d05791a321" status: 200 len: 1230 microversion: 2.1 time: 0.165085 Aug 03 05:23:17.132249 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 486/1003] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:16 2022] GET /compute/v2.1/servers/64b183db-1997-4a33-9bb9-40d05791a321 => generated 1230 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:23:17.428381 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-1860b88d-3910-4c9c-8c1d-94254d32bacc tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:17.429127 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-1860b88d-3910-4c9c-8c1d-94254d32bacc tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: d6b60ff4-a76f-4b50-8e1b-2b11561286b2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:17.440579 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1860b88d-3910-4c9c-8c1d-94254d32bacc tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:17.440579 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1860b88d-3910-4c9c-8c1d-94254d32bacc tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:17.440579 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1860b88d-3910-4c9c-8c1d-94254d32bacc tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:17.441557 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1860b88d-3910-4c9c-8c1d-94254d32bacc tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:17.667966 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-1860b88d-3910-4c9c-8c1d-94254d32bacc tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729a6d00e1664a6298088e52de9999f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041a553912c64de981d9f87b551c190f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:23:17.677038 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-1860b88d-3910-4c9c-8c1d-94254d32bacc tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/d6b60ff4-a76f-4b50-8e1b-2b11561286b2" status: 200 len: 1366 microversion: 2.1 time: 0.253311 Aug 03 05:23:17.677627 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 518/1004] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:17 2022] GET /compute/v2.1/servers/d6b60ff4-a76f-4b50-8e1b-2b11561286b2 => generated 1366 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:23:18.143659 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-a3ddcaea-3b09-499f-9866-db66fa76e7a0 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:18.144265 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-a3ddcaea-3b09-499f-9866-db66fa76e7a0 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: 64b183db-1997-4a33-9bb9-40d05791a321] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:18.150706 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-a3ddcaea-3b09-499f-9866-db66fa76e7a0 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:18.151221 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-a3ddcaea-3b09-499f-9866-db66fa76e7a0 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:18.152030 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-a3ddcaea-3b09-499f-9866-db66fa76e7a0 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:18.152469 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-a3ddcaea-3b09-499f-9866-db66fa76e7a0 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:18.166494 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.wsgi [None req-a3ddcaea-3b09-499f-9866-db66fa76e7a0 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] HTTP exception thrown: Instance 64b183db-1997-4a33-9bb9-40d05791a321 could not be found. Aug 03 05:23:18.168170 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-a3ddcaea-3b09-499f-9866-db66fa76e7a0 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Request method failure captured: Aug 03 05:23:18.168170 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: request: GET /compute/v2.1/servers/64b183db-1997-4a33-9bb9-40d05791a321 HTTP/1.1 Aug 03 05:23:18.168170 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Accept: application/json Aug 03 05:23:18.168170 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Accept-Encoding: identity Aug 03 05:23:18.168170 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Connection: close Aug 03 05:23:18.168170 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Content-Length: 0 Aug 03 05:23:18.168170 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Content-Type: application/json Aug 03 05:23:18.168170 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Host: 10.222.0.40 Aug 03 05:23:18.168170 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Openstack-System-Scope: None Aug 03 05:23:18.168170 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: User-Agent: python-urllib3/1.26.10 Aug 03 05:23:18.168170 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Auth-Token: gAAAAABi6gWSYRh4SIatsra1g2LsGgASzfpCWnbkx3mL9veL_SX6_v-A3hHe9snMK_7atxQsPVdxJ1_sB6cO9xOQtejQWbnf_VOCBB9ykLS1uCX_dbo_aSYGxu-wNzlw-Ohtd8Amkx7uh8mMMcR9FLSaZEtRipG5lMYEHcfObQ4Na4khvJvMvEc Aug 03 05:23:18.168170 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Domain-Id: None Aug 03 05:23:18.168170 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Domain-Name: None Aug 03 05:23:18.168170 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Identity-Status: Confirmed Aug 03 05:23:18.168170 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Is-Admin-Project: True Aug 03 05:23:18.168170 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Domain-Id: default Aug 03 05:23:18.168170 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Domain-Name: Default Aug 03 05:23:18.168170 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Id: 3c986ef0f5ea46f9b5e788aaca042b06 Aug 03 05:23:18.168170 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Name: tempest-TestVolumeBootPattern-134846104 Aug 03 05:23:18.168170 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Role: member,reader Aug 03 05:23:18.168170 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Roles: member,reader Aug 03 05:23:18.169928 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3c986ef0f5ea46f9b5e788aaca042b06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3c986ef0f5ea46f9b5e788aaca042b06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3c986ef0f5ea46f9b5e788aaca042b06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3c986ef0f5ea46f9b5e788aaca042b06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:23:18.169928 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant: tempest-TestVolumeBootPattern-134846104 Aug 03 05:23:18.169928 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant-Id: 3c986ef0f5ea46f9b5e788aaca042b06 Aug 03 05:23:18.169928 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant-Name: tempest-TestVolumeBootPattern-134846104 Aug 03 05:23:18.169928 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User: tempest-TestVolumeBootPattern-134846104-project Aug 03 05:23:18.169928 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Domain-Id: default Aug 03 05:23:18.169928 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Domain-Name: Default Aug 03 05:23:18.169928 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Id: ac3954ab39014ef3819111a6fe8142b7 Aug 03 05:23:18.169928 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Name: tempest-TestVolumeBootPattern-134846104-project Aug 03 05:23:18.169928 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: method: > Aug 03 05:23:18.169928 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: exception: Instance 64b183db-1997-4a33-9bb9-40d05791a321 could not be found. Aug 03 05:23:18.169928 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: action_args: {'id': '64b183db-1997-4a33-9bb9-40d05791a321'} Aug 03 05:23:18.170938 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:23:18.170938 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:23:18.170938 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:23:18.170938 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:23:18.170938 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:23:18.170938 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:23:18.170938 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:23:18.170938 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:23:18.170938 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:23:18.170938 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:23:18.170938 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64b183db-1997-4a33-9bb9-40d05791a321 could not be found. Aug 03 05:23:18.170938 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:23:18.170938 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:23:18.170938 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:23:18.170938 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:23:18.170938 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:23:18.170938 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:23:18.170938 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:23:18.170938 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:23:18.170938 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:23:18.173135 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:23:18.173135 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:23:18.173135 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:23:18.173135 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:23:18.173135 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:23:18.173135 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:23:18.173135 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:23:18.173135 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64b183db-1997-4a33-9bb9-40d05791a321 could not be found. Aug 03 05:23:18.173135 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:23:18.173135 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:23:18.173135 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:23:18.173135 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:23:18.173135 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:23:18.173135 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:23:18.173135 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:23:18.173135 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:23:18.173135 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64b183db-1997-4a33-9bb9-40d05791a321 could not be found. Aug 03 05:23:18.173135 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:23:18.174520 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-a3ddcaea-3b09-499f-9866-db66fa76e7a0 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Returning 404 to user: Instance 64b183db-1997-4a33-9bb9-40d05791a321 could not be found. {{(pid=118332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:23:18.174520 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-a3ddcaea-3b09-499f-9866-db66fa76e7a0 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/64b183db-1997-4a33-9bb9-40d05791a321" status: 404 len: 111 microversion: 2.1 time: 0.029846 Aug 03 05:23:18.174520 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 487/1005] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:18 2022] GET /compute/v2.1/servers/64b183db-1997-4a33-9bb9-40d05791a321 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:23:18.240305 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-379a6e29-1c1b-4434-a509-412a98f52cfd req-4c0d31e8-3370-444a-9f28-36d1d1a95cb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6b60ff4-a76f-4b50-8e1b-2b11561286b2", "tag": "6bc0e545-9f39-46f2-8635-27046794f1cd"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:23:18.249971 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-379a6e29-1c1b-4434-a509-412a98f52cfd req-4c0d31e8-3370-444a-9f28-36d1d1a95cb5 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:18.250423 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-379a6e29-1c1b-4434-a509-412a98f52cfd req-4c0d31e8-3370-444a-9f28-36d1d1a95cb5 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:18.263930 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-379a6e29-1c1b-4434-a509-412a98f52cfd req-4c0d31e8-3370-444a-9f28-36d1d1a95cb5 service nova] Creating event network-changed:6bc0e545-9f39-46f2-8635-27046794f1cd for instance d6b60ff4-a76f-4b50-8e1b-2b11561286b2 on hv-cinder-85127 Aug 03 05:23:18.268823 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-a9fc7e5b-e88c-4a18-b2ed-56a8c809a638 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1550805769", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1057909603", "security_groups": [{"name": "tempest-secgroup-smoke-1007032199"}], "block_device_mapping_v2": [{"uuid": "15e172bc-6901-4cd0-8f2b-0df5ac25f976", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d274ff51-9652-4d23-8cbb-d03e5409ca96"}]}} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:23:18.270172 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-379a6e29-1c1b-4434-a509-412a98f52cfd req-4c0d31e8-3370-444a-9f28-36d1d1a95cb5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033474 Aug 03 05:23:18.270873 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 519/1006] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:23:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:23:18.380833 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.network.neutron [None req-a9fc7e5b-e88c-4a18-b2ed-56a8c809a638 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] validate_networks() for [('d274ff51-9652-4d23-8cbb-d03e5409ca96', None, None, None, None, None)] {{(pid=118332) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:23:18.704928 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-a8378f65-a1ab-4414-b934-cff89e099db6 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:18.705633 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-a8378f65-a1ab-4414-b934-cff89e099db6 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: d6b60ff4-a76f-4b50-8e1b-2b11561286b2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:18.712422 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a8378f65-a1ab-4414-b934-cff89e099db6 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:18.712888 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a8378f65-a1ab-4414-b934-cff89e099db6 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:18.713662 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a8378f65-a1ab-4414-b934-cff89e099db6 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:18.714107 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a8378f65-a1ab-4414-b934-cff89e099db6 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:19.047356 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-a8378f65-a1ab-4414-b934-cff89e099db6 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729a6d00e1664a6298088e52de9999f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041a553912c64de981d9f87b551c190f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:23:19.054738 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-a8378f65-a1ab-4414-b934-cff89e099db6 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/d6b60ff4-a76f-4b50-8e1b-2b11561286b2" status: 200 len: 1366 microversion: 2.1 time: 0.354473 Aug 03 05:23:19.055338 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 520/1007] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:18 2022] GET /compute/v2.1/servers/d6b60ff4-a76f-4b50-8e1b-2b11561286b2 => generated 1366 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:23:19.156445 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.virt.hardware [None req-a9fc7e5b-e88c-4a18-b2ed-56a8c809a638 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Flavor limits 0:0:0 {{(pid=118332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:23:19.156915 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.virt.hardware [None req-a9fc7e5b-e88c-4a18-b2ed-56a8c809a638 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Image limits 0:0:0 {{(pid=118332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:23:19.157326 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.virt.hardware [None req-a9fc7e5b-e88c-4a18-b2ed-56a8c809a638 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Flavor pref 0:0:0 {{(pid=118332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:23:19.157732 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.virt.hardware [None req-a9fc7e5b-e88c-4a18-b2ed-56a8c809a638 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Image pref 0:0:0 {{(pid=118332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:23:19.158142 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.virt.hardware [None req-a9fc7e5b-e88c-4a18-b2ed-56a8c809a638 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:23:19.167391 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-a9fc7e5b-e88c-4a18-b2ed-56a8c809a638 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:19.167836 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-a9fc7e5b-e88c-4a18-b2ed-56a8c809a638 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:19.168634 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-a9fc7e5b-e88c-4a18-b2ed-56a8c809a638 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:19.169067 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-a9fc7e5b-e88c-4a18-b2ed-56a8c809a638 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:19.186014 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.quota [None req-a9fc7e5b-e88c-4a18-b2ed-56a8c809a638 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Getting quotas for project 3c986ef0f5ea46f9b5e788aaca042b06. Resources: {'instances', 'ram', 'cores'} {{(pid=118332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:23:19.190813 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.quota [None req-a9fc7e5b-e88c-4a18-b2ed-56a8c809a638 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Getting quotas for user ac3954ab39014ef3819111a6fe8142b7 and project 3c986ef0f5ea46f9b5e788aaca042b06. Resources: {'instances', 'ram', 'cores'} {{(pid=118332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:23:19.253847 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-a9fc7e5b-e88c-4a18-b2ed-56a8c809a638 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Going to run 1 instances... {{(pid=118332) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:23:19.256069 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-a9fc7e5b-e88c-4a18-b2ed-56a8c809a638 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: f9d2fd48-b6b2-4952-8d15-3164c5f9635f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='15e172bc-6901-4cd0-8f2b-0df5ac25f976',volume_size=None,volume_type=None)] {{(pid=118332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:23:19.732510 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-a9fc7e5b-e88c-4a18-b2ed-56a8c809a638 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.467432 Aug 03 05:23:19.733156 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 488/1008] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Aug 3 05:23:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 1469 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 05:23:19.744574 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-4f491276-e82b-4234-8966-a5058b7e66e8 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:19.745792 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-4f491276-e82b-4234-8966-a5058b7e66e8 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: f9d2fd48-b6b2-4952-8d15-3164c5f9635f] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:19.801959 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-4f491276-e82b-4234-8966-a5058b7e66e8 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3954ab39014ef3819111a6fe8142b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c986ef0f5ea46f9b5e788aaca042b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:23:19.809425 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-4f491276-e82b-4234-8966-a5058b7e66e8 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/f9d2fd48-b6b2-4952-8d15-3164c5f9635f" status: 200 len: 1095 microversion: 2.1 time: 0.068653 Aug 03 05:23:19.810208 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 521/1009] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:19 2022] GET /compute/v2.1/servers/f9d2fd48-b6b2-4952-8d15-3164c5f9635f => generated 1095 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:23:20.077257 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-2bd346c7-c895-4d2e-bb4b-047f0d762907 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:20.077878 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-2bd346c7-c895-4d2e-bb4b-047f0d762907 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: d6b60ff4-a76f-4b50-8e1b-2b11561286b2] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:20.084799 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-2bd346c7-c895-4d2e-bb4b-047f0d762907 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:20.085256 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-2bd346c7-c895-4d2e-bb4b-047f0d762907 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:20.086022 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-2bd346c7-c895-4d2e-bb4b-047f0d762907 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:20.086463 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-2bd346c7-c895-4d2e-bb4b-047f0d762907 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:20.223070 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-2bd346c7-c895-4d2e-bb4b-047f0d762907 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729a6d00e1664a6298088e52de9999f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041a553912c64de981d9f87b551c190f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:23:20.230501 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-2bd346c7-c895-4d2e-bb4b-047f0d762907 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/d6b60ff4-a76f-4b50-8e1b-2b11561286b2" status: 200 len: 1366 microversion: 2.1 time: 0.157416 Aug 03 05:23:20.231115 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 489/1010] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:20 2022] GET /compute/v2.1/servers/d6b60ff4-a76f-4b50-8e1b-2b11561286b2 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:23:20.831576 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-4076e1f4-a05d-437f-b522-9bb3b05a8459 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:20.833604 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-4076e1f4-a05d-437f-b522-9bb3b05a8459 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: f9d2fd48-b6b2-4952-8d15-3164c5f9635f] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:20.850347 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4076e1f4-a05d-437f-b522-9bb3b05a8459 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:20.851149 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4076e1f4-a05d-437f-b522-9bb3b05a8459 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:20.852249 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4076e1f4-a05d-437f-b522-9bb3b05a8459 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:20.852700 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4076e1f4-a05d-437f-b522-9bb3b05a8459 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:20.917436 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-4076e1f4-a05d-437f-b522-9bb3b05a8459 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3954ab39014ef3819111a6fe8142b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c986ef0f5ea46f9b5e788aaca042b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:23:20.926305 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-4076e1f4-a05d-437f-b522-9bb3b05a8459 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/f9d2fd48-b6b2-4952-8d15-3164c5f9635f" status: 200 len: 1137 microversion: 2.1 time: 0.099536 Aug 03 05:23:20.927144 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 522/1011] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:20 2022] GET /compute/v2.1/servers/f9d2fd48-b6b2-4952-8d15-3164c5f9635f => generated 1137 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:23:21.251517 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-6cc7e009-87c7-4f88-8f26-9c2054b1577f tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:21.252790 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-6cc7e009-87c7-4f88-8f26-9c2054b1577f tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: d6b60ff4-a76f-4b50-8e1b-2b11561286b2] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:21.259617 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-6cc7e009-87c7-4f88-8f26-9c2054b1577f tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:21.260075 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-6cc7e009-87c7-4f88-8f26-9c2054b1577f tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:21.260860 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-6cc7e009-87c7-4f88-8f26-9c2054b1577f tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:21.261306 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-6cc7e009-87c7-4f88-8f26-9c2054b1577f tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:21.460878 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-6cc7e009-87c7-4f88-8f26-9c2054b1577f tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729a6d00e1664a6298088e52de9999f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041a553912c64de981d9f87b551c190f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:23:21.468347 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-6cc7e009-87c7-4f88-8f26-9c2054b1577f tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/d6b60ff4-a76f-4b50-8e1b-2b11561286b2" status: 200 len: 1366 microversion: 2.1 time: 0.220776 Aug 03 05:23:21.482187 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 490/1012] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:21 2022] GET /compute/v2.1/servers/d6b60ff4-a76f-4b50-8e1b-2b11561286b2 => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:23:21.948608 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-bace1e61-7c3e-4822-9137-d71a2ecb0471 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:21.949224 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-bace1e61-7c3e-4822-9137-d71a2ecb0471 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: f9d2fd48-b6b2-4952-8d15-3164c5f9635f] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:21.956792 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bace1e61-7c3e-4822-9137-d71a2ecb0471 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:21.957427 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bace1e61-7c3e-4822-9137-d71a2ecb0471 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:21.958228 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bace1e61-7c3e-4822-9137-d71a2ecb0471 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:21.958670 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bace1e61-7c3e-4822-9137-d71a2ecb0471 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:22.233582 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-bace1e61-7c3e-4822-9137-d71a2ecb0471 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3954ab39014ef3819111a6fe8142b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c986ef0f5ea46f9b5e788aaca042b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:23:22.241948 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-bace1e61-7c3e-4822-9137-d71a2ecb0471 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/f9d2fd48-b6b2-4952-8d15-3164c5f9635f" status: 200 len: 1211 microversion: 2.1 time: 0.297622 Aug 03 05:23:22.242936 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 523/1013] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:21 2022] GET /compute/v2.1/servers/f9d2fd48-b6b2-4952-8d15-3164c5f9635f => generated 1211 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:23:22.490125 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-0d05f637-fd27-4f6a-8711-f80eed5897f6 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:22.490747 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-0d05f637-fd27-4f6a-8711-f80eed5897f6 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: d6b60ff4-a76f-4b50-8e1b-2b11561286b2] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:22.497540 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-0d05f637-fd27-4f6a-8711-f80eed5897f6 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:22.498299 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-0d05f637-fd27-4f6a-8711-f80eed5897f6 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:22.499404 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-0d05f637-fd27-4f6a-8711-f80eed5897f6 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:22.501163 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-0d05f637-fd27-4f6a-8711-f80eed5897f6 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:22.526476 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:23:22.540001 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-2608b42b-2465-4740-ab28-45ed09db6e22 req-793c6e78-b30b-4ce3-84c0-5eb766ef8a0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6b60ff4-a76f-4b50-8e1b-2b11561286b2", "name": "network-vif-plugged", "status": "completed", "tag": "6bc0e545-9f39-46f2-8635-27046794f1cd"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:23:22.559159 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-2608b42b-2465-4740-ab28-45ed09db6e22 req-793c6e78-b30b-4ce3-84c0-5eb766ef8a0f service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:22.563332 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-2608b42b-2465-4740-ab28-45ed09db6e22 req-793c6e78-b30b-4ce3-84c0-5eb766ef8a0f service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:22.573432 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-2608b42b-2465-4740-ab28-45ed09db6e22 req-793c6e78-b30b-4ce3-84c0-5eb766ef8a0f service nova] Creating event network-vif-plugged:6bc0e545-9f39-46f2-8635-27046794f1cd for instance d6b60ff4-a76f-4b50-8e1b-2b11561286b2 on hv-cinder-85127 Aug 03 05:23:22.578880 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-2608b42b-2465-4740-ab28-45ed09db6e22 req-793c6e78-b30b-4ce3-84c0-5eb766ef8a0f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042136 Aug 03 05:23:22.579435 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 524/1014] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:23:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:23:22.711398 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-0d05f637-fd27-4f6a-8711-f80eed5897f6 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729a6d00e1664a6298088e52de9999f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041a553912c64de981d9f87b551c190f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:23:22.719953 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-0d05f637-fd27-4f6a-8711-f80eed5897f6 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/d6b60ff4-a76f-4b50-8e1b-2b11561286b2" status: 200 len: 1366 microversion: 2.1 time: 0.233588 Aug 03 05:23:22.720571 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 491/1015] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:22 2022] GET /compute/v2.1/servers/d6b60ff4-a76f-4b50-8e1b-2b11561286b2 => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:23:23.267732 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-f4b4ecf7-4793-4842-a5cf-69bd1af24c99 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:23.268429 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-f4b4ecf7-4793-4842-a5cf-69bd1af24c99 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: f9d2fd48-b6b2-4952-8d15-3164c5f9635f] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:23.274742 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f4b4ecf7-4793-4842-a5cf-69bd1af24c99 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:23.275233 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f4b4ecf7-4793-4842-a5cf-69bd1af24c99 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:23.276008 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f4b4ecf7-4793-4842-a5cf-69bd1af24c99 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:23.276452 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f4b4ecf7-4793-4842-a5cf-69bd1af24c99 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:23.452679 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-f4b4ecf7-4793-4842-a5cf-69bd1af24c99 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3954ab39014ef3819111a6fe8142b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c986ef0f5ea46f9b5e788aaca042b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:23:23.460184 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-f4b4ecf7-4793-4842-a5cf-69bd1af24c99 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/f9d2fd48-b6b2-4952-8d15-3164c5f9635f" status: 200 len: 1267 microversion: 2.1 time: 0.197205 Aug 03 05:23:23.460739 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 525/1016] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:23 2022] GET /compute/v2.1/servers/f9d2fd48-b6b2-4952-8d15-3164c5f9635f => generated 1267 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:23:23.485774 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [req-a6d4463a-7719-40dc-a34b-00b189020371 req-423a14e3-a803-483c-b437-30f6e3b964fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9d2fd48-b6b2-4952-8d15-3164c5f9635f", "tag": "4f95730f-3cba-4151-98a6-89c74a9d9cce"}]} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:23:23.496128 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-a6d4463a-7719-40dc-a34b-00b189020371 req-423a14e3-a803-483c-b437-30f6e3b964fe service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:23.496681 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-a6d4463a-7719-40dc-a34b-00b189020371 req-423a14e3-a803-483c-b437-30f6e3b964fe service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:23.509858 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.compute.server_external_events [req-a6d4463a-7719-40dc-a34b-00b189020371 req-423a14e3-a803-483c-b437-30f6e3b964fe service nova] Creating event network-changed:4f95730f-3cba-4151-98a6-89c74a9d9cce for instance f9d2fd48-b6b2-4952-8d15-3164c5f9635f on hv-cinder-85127 Aug 03 05:23:23.514560 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [req-a6d4463a-7719-40dc-a34b-00b189020371 req-423a14e3-a803-483c-b437-30f6e3b964fe service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033501 Aug 03 05:23:23.515185 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 492/1017] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:23:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:23:23.740765 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-27da6bad-8b51-4174-a01b-47858414f66f tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:23.741388 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-27da6bad-8b51-4174-a01b-47858414f66f tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: d6b60ff4-a76f-4b50-8e1b-2b11561286b2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:23.747456 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-27da6bad-8b51-4174-a01b-47858414f66f tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:23.747932 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-27da6bad-8b51-4174-a01b-47858414f66f tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:23.748716 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-27da6bad-8b51-4174-a01b-47858414f66f tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:23.749164 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-27da6bad-8b51-4174-a01b-47858414f66f tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:23.933271 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-27da6bad-8b51-4174-a01b-47858414f66f tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729a6d00e1664a6298088e52de9999f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041a553912c64de981d9f87b551c190f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:23:23.941336 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-27da6bad-8b51-4174-a01b-47858414f66f tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/d6b60ff4-a76f-4b50-8e1b-2b11561286b2" status: 200 len: 1366 microversion: 2.1 time: 0.204515 Aug 03 05:23:23.941903 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 526/1018] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:23 2022] GET /compute/v2.1/servers/d6b60ff4-a76f-4b50-8e1b-2b11561286b2 => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:23:24.482715 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-06b4ed55-5e2e-482d-aebf-11751fc898e2 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:24.483447 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-06b4ed55-5e2e-482d-aebf-11751fc898e2 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: f9d2fd48-b6b2-4952-8d15-3164c5f9635f] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:24.489827 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-06b4ed55-5e2e-482d-aebf-11751fc898e2 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:24.490286 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-06b4ed55-5e2e-482d-aebf-11751fc898e2 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:24.491085 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-06b4ed55-5e2e-482d-aebf-11751fc898e2 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:24.491531 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-06b4ed55-5e2e-482d-aebf-11751fc898e2 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:24.707106 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-06b4ed55-5e2e-482d-aebf-11751fc898e2 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3954ab39014ef3819111a6fe8142b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c986ef0f5ea46f9b5e788aaca042b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:23:24.714573 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-06b4ed55-5e2e-482d-aebf-11751fc898e2 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/f9d2fd48-b6b2-4952-8d15-3164c5f9635f" status: 200 len: 1267 microversion: 2.1 time: 0.236459 Aug 03 05:23:24.720706 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 493/1019] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:24 2022] GET /compute/v2.1/servers/f9d2fd48-b6b2-4952-8d15-3164c5f9635f => generated 1267 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:23:24.961516 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-faa689f9-4bbf-4448-9b03-b1247a1fc901 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:24.962062 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-faa689f9-4bbf-4448-9b03-b1247a1fc901 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: d6b60ff4-a76f-4b50-8e1b-2b11561286b2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:24.968576 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-faa689f9-4bbf-4448-9b03-b1247a1fc901 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:24.969531 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-faa689f9-4bbf-4448-9b03-b1247a1fc901 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:24.970299 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-faa689f9-4bbf-4448-9b03-b1247a1fc901 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:24.970742 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-faa689f9-4bbf-4448-9b03-b1247a1fc901 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:25.099183 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-faa689f9-4bbf-4448-9b03-b1247a1fc901 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729a6d00e1664a6298088e52de9999f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041a553912c64de981d9f87b551c190f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:23:25.106857 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-faa689f9-4bbf-4448-9b03-b1247a1fc901 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/d6b60ff4-a76f-4b50-8e1b-2b11561286b2" status: 200 len: 1555 microversion: 2.1 time: 0.149239 Aug 03 05:23:25.107429 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 527/1020] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:24 2022] GET /compute/v2.1/servers/d6b60ff4-a76f-4b50-8e1b-2b11561286b2 => generated 1555 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:23:25.127599 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-a175c998-53e4-4d1f-bd76-a9c165d4cbcf tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:25.128107 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-a175c998-53e4-4d1f-bd76-a9c165d4cbcf tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: d6b60ff4-a76f-4b50-8e1b-2b11561286b2] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:25.134159 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-a175c998-53e4-4d1f-bd76-a9c165d4cbcf tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:25.134616 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-a175c998-53e4-4d1f-bd76-a9c165d4cbcf tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:25.135414 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-a175c998-53e4-4d1f-bd76-a9c165d4cbcf tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:25.135865 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-a175c998-53e4-4d1f-bd76-a9c165d4cbcf tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:25.211456 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-a175c998-53e4-4d1f-bd76-a9c165d4cbcf tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/d6b60ff4-a76f-4b50-8e1b-2b11561286b2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087692 Aug 03 05:23:25.212151 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 494/1021] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Aug 3 05:23:25 2022] GET /compute/v2.1/servers/d6b60ff4-a76f-4b50-8e1b-2b11561286b2/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:23:25.735680 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-74ad0a83-1604-42f9-9a77-05bbba9c84ff tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:25.737001 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-74ad0a83-1604-42f9-9a77-05bbba9c84ff tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: f9d2fd48-b6b2-4952-8d15-3164c5f9635f] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:25.742432 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-74ad0a83-1604-42f9-9a77-05bbba9c84ff tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:25.742992 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-74ad0a83-1604-42f9-9a77-05bbba9c84ff tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:25.743792 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-74ad0a83-1604-42f9-9a77-05bbba9c84ff tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:25.744236 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-74ad0a83-1604-42f9-9a77-05bbba9c84ff tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:25.879759 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-74ad0a83-1604-42f9-9a77-05bbba9c84ff tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3954ab39014ef3819111a6fe8142b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c986ef0f5ea46f9b5e788aaca042b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:23:25.888155 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-74ad0a83-1604-42f9-9a77-05bbba9c84ff tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/f9d2fd48-b6b2-4952-8d15-3164c5f9635f" status: 200 len: 1267 microversion: 2.1 time: 0.156412 Aug 03 05:23:25.888725 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 528/1022] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:25 2022] GET /compute/v2.1/servers/f9d2fd48-b6b2-4952-8d15-3164c5f9635f => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:23:26.248816 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [req-4c25cf72-9ba6-4bef-aa2e-223a8367bd6d req-aea7148e-1cdc-4e7d-9278-88728fa3aeda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6b60ff4-a76f-4b50-8e1b-2b11561286b2", "tag": "6bc0e545-9f39-46f2-8635-27046794f1cd"}]} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:23:26.258963 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-4c25cf72-9ba6-4bef-aa2e-223a8367bd6d req-aea7148e-1cdc-4e7d-9278-88728fa3aeda service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:26.259408 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-4c25cf72-9ba6-4bef-aa2e-223a8367bd6d req-aea7148e-1cdc-4e7d-9278-88728fa3aeda service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:26.270406 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.compute.server_external_events [req-4c25cf72-9ba6-4bef-aa2e-223a8367bd6d req-aea7148e-1cdc-4e7d-9278-88728fa3aeda service nova] Creating event network-changed:6bc0e545-9f39-46f2-8635-27046794f1cd for instance d6b60ff4-a76f-4b50-8e1b-2b11561286b2 on hv-cinder-85127 Aug 03 05:23:26.276087 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [req-4c25cf72-9ba6-4bef-aa2e-223a8367bd6d req-aea7148e-1cdc-4e7d-9278-88728fa3aeda service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099459 Aug 03 05:23:26.276686 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 495/1023] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:23:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:23:26.914343 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-43e587f1-05df-48df-9f62-165edef8db57 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:26.915324 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-43e587f1-05df-48df-9f62-165edef8db57 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: f9d2fd48-b6b2-4952-8d15-3164c5f9635f] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:26.922514 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-43e587f1-05df-48df-9f62-165edef8db57 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:26.922999 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-43e587f1-05df-48df-9f62-165edef8db57 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:26.923833 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-43e587f1-05df-48df-9f62-165edef8db57 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:26.924271 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-43e587f1-05df-48df-9f62-165edef8db57 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:27.062823 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-43e587f1-05df-48df-9f62-165edef8db57 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3954ab39014ef3819111a6fe8142b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c986ef0f5ea46f9b5e788aaca042b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:23:27.070979 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-43e587f1-05df-48df-9f62-165edef8db57 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/f9d2fd48-b6b2-4952-8d15-3164c5f9635f" status: 200 len: 1267 microversion: 2.1 time: 0.161336 Aug 03 05:23:27.072102 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 529/1024] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:26 2022] GET /compute/v2.1/servers/f9d2fd48-b6b2-4952-8d15-3164c5f9635f => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:23:28.093787 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-0bc1c261-4a9b-4e7e-be6c-c188fd25e219 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:28.094486 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-0bc1c261-4a9b-4e7e-be6c-c188fd25e219 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: f9d2fd48-b6b2-4952-8d15-3164c5f9635f] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:28.096941 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:23:28.102011 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-0bc1c261-4a9b-4e7e-be6c-c188fd25e219 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:28.102476 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-0bc1c261-4a9b-4e7e-be6c-c188fd25e219 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:28.103277 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-0bc1c261-4a9b-4e7e-be6c-c188fd25e219 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:28.103724 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-0bc1c261-4a9b-4e7e-be6c-c188fd25e219 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:28.238155 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-0bc1c261-4a9b-4e7e-be6c-c188fd25e219 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3954ab39014ef3819111a6fe8142b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c986ef0f5ea46f9b5e788aaca042b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:23:28.245624 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-0bc1c261-4a9b-4e7e-be6c-c188fd25e219 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/f9d2fd48-b6b2-4952-8d15-3164c5f9635f" status: 200 len: 1267 microversion: 2.1 time: 0.156052 Aug 03 05:23:28.246199 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 496/1025] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:28 2022] GET /compute/v2.1/servers/f9d2fd48-b6b2-4952-8d15-3164c5f9635f => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:23:29.266308 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-5288ece1-ce30-40fc-acb0-a38f54bdcb93 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:29.267026 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-5288ece1-ce30-40fc-acb0-a38f54bdcb93 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: f9d2fd48-b6b2-4952-8d15-3164c5f9635f] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:29.269642 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:23:29.274647 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5288ece1-ce30-40fc-acb0-a38f54bdcb93 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:29.275137 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5288ece1-ce30-40fc-acb0-a38f54bdcb93 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:29.275929 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5288ece1-ce30-40fc-acb0-a38f54bdcb93 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:29.276382 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5288ece1-ce30-40fc-acb0-a38f54bdcb93 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:29.412717 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-5288ece1-ce30-40fc-acb0-a38f54bdcb93 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3954ab39014ef3819111a6fe8142b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c986ef0f5ea46f9b5e788aaca042b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:23:29.420147 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-5288ece1-ce30-40fc-acb0-a38f54bdcb93 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/f9d2fd48-b6b2-4952-8d15-3164c5f9635f" status: 200 len: 1267 microversion: 2.1 time: 0.157807 Aug 03 05:23:29.420717 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 530/1026] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:29 2022] GET /compute/v2.1/servers/f9d2fd48-b6b2-4952-8d15-3164c5f9635f => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:23:30.442318 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-aeacfc79-c105-4c6b-8e3e-63e13ea42ec7 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:30.442982 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-aeacfc79-c105-4c6b-8e3e-63e13ea42ec7 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: f9d2fd48-b6b2-4952-8d15-3164c5f9635f] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:30.445253 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_cell0:SELECT=4 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:23:30.445949 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_cell0:SELECT=12 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:23:30.451132 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-aeacfc79-c105-4c6b-8e3e-63e13ea42ec7 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:30.451591 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-aeacfc79-c105-4c6b-8e3e-63e13ea42ec7 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:30.452358 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-aeacfc79-c105-4c6b-8e3e-63e13ea42ec7 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:30.452797 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-aeacfc79-c105-4c6b-8e3e-63e13ea42ec7 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:30.582068 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-aeacfc79-c105-4c6b-8e3e-63e13ea42ec7 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3954ab39014ef3819111a6fe8142b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c986ef0f5ea46f9b5e788aaca042b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:23:30.589636 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-aeacfc79-c105-4c6b-8e3e-63e13ea42ec7 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/f9d2fd48-b6b2-4952-8d15-3164c5f9635f" status: 200 len: 1267 microversion: 2.1 time: 0.151149 Aug 03 05:23:30.590202 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 497/1027] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:30 2022] GET /compute/v2.1/servers/f9d2fd48-b6b2-4952-8d15-3164c5f9635f => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:23:31.610825 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-fba1814f-6c13-40f2-b572-e5e00bd9278c tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:31.611484 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-fba1814f-6c13-40f2-b572-e5e00bd9278c tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: f9d2fd48-b6b2-4952-8d15-3164c5f9635f] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:31.613338 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell0:SELECT=8 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:23:31.618603 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fba1814f-6c13-40f2-b572-e5e00bd9278c tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:31.619093 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fba1814f-6c13-40f2-b572-e5e00bd9278c tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:31.619854 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fba1814f-6c13-40f2-b572-e5e00bd9278c tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:31.620290 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fba1814f-6c13-40f2-b572-e5e00bd9278c tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:31.757656 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-fba1814f-6c13-40f2-b572-e5e00bd9278c tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3954ab39014ef3819111a6fe8142b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c986ef0f5ea46f9b5e788aaca042b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:23:31.765005 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-fba1814f-6c13-40f2-b572-e5e00bd9278c tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/f9d2fd48-b6b2-4952-8d15-3164c5f9635f" status: 200 len: 1267 microversion: 2.1 time: 0.158788 Aug 03 05:23:31.765561 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 531/1028] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:31 2022] GET /compute/v2.1/servers/f9d2fd48-b6b2-4952-8d15-3164c5f9635f => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:23:32.785589 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-c52a3e4a-6a0f-4069-8a26-c7940f010800 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:32.786221 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-c52a3e4a-6a0f-4069-8a26-c7940f010800 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: f9d2fd48-b6b2-4952-8d15-3164c5f9635f] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:32.792708 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-c52a3e4a-6a0f-4069-8a26-c7940f010800 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:32.793166 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-c52a3e4a-6a0f-4069-8a26-c7940f010800 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:32.793942 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-c52a3e4a-6a0f-4069-8a26-c7940f010800 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:32.794386 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-c52a3e4a-6a0f-4069-8a26-c7940f010800 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:32.926518 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-c52a3e4a-6a0f-4069-8a26-c7940f010800 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3954ab39014ef3819111a6fe8142b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c986ef0f5ea46f9b5e788aaca042b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:23:32.934085 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-c52a3e4a-6a0f-4069-8a26-c7940f010800 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/f9d2fd48-b6b2-4952-8d15-3164c5f9635f" status: 200 len: 1267 microversion: 2.1 time: 0.152286 Aug 03 05:23:32.952830 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 498/1029] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:32 2022] GET /compute/v2.1/servers/f9d2fd48-b6b2-4952-8d15-3164c5f9635f => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:23:33.957472 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-12f6f7d0-733d-4312-9e05-2b2b0e3ed86d tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:33.958045 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-12f6f7d0-733d-4312-9e05-2b2b0e3ed86d tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: f9d2fd48-b6b2-4952-8d15-3164c5f9635f] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:33.964582 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-12f6f7d0-733d-4312-9e05-2b2b0e3ed86d tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:33.965041 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-12f6f7d0-733d-4312-9e05-2b2b0e3ed86d tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:33.965816 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-12f6f7d0-733d-4312-9e05-2b2b0e3ed86d tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:33.966265 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-12f6f7d0-733d-4312-9e05-2b2b0e3ed86d tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:34.100299 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-12f6f7d0-733d-4312-9e05-2b2b0e3ed86d tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3954ab39014ef3819111a6fe8142b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c986ef0f5ea46f9b5e788aaca042b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:23:34.108011 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-12f6f7d0-733d-4312-9e05-2b2b0e3ed86d tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/f9d2fd48-b6b2-4952-8d15-3164c5f9635f" status: 200 len: 1267 microversion: 2.1 time: 0.156306 Aug 03 05:23:34.108586 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 532/1030] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:33 2022] GET /compute/v2.1/servers/f9d2fd48-b6b2-4952-8d15-3164c5f9635f => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:23:34.533707 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [req-81794509-96b2-4b19-95a4-5f28612559be req-694596da-3d45-4418-a138-3a27fcfd4fe7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9d2fd48-b6b2-4952-8d15-3164c5f9635f", "name": "network-vif-plugged", "status": "completed", "tag": "4f95730f-3cba-4151-98a6-89c74a9d9cce"}]} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:23:34.543859 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-81794509-96b2-4b19-95a4-5f28612559be req-694596da-3d45-4418-a138-3a27fcfd4fe7 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:34.544309 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-81794509-96b2-4b19-95a4-5f28612559be req-694596da-3d45-4418-a138-3a27fcfd4fe7 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:34.555769 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.compute.server_external_events [req-81794509-96b2-4b19-95a4-5f28612559be req-694596da-3d45-4418-a138-3a27fcfd4fe7 service nova] Creating event network-vif-plugged:4f95730f-3cba-4151-98a6-89c74a9d9cce for instance f9d2fd48-b6b2-4952-8d15-3164c5f9635f on hv-cinder-85127 Aug 03 05:23:34.560783 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [req-81794509-96b2-4b19-95a4-5f28612559be req-694596da-3d45-4418-a138-3a27fcfd4fe7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031441 Aug 03 05:23:34.562473 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 499/1031] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:23:35.128735 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-639db866-a8e1-4470-a512-c037903a1ffe tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:35.129281 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-639db866-a8e1-4470-a512-c037903a1ffe tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: f9d2fd48-b6b2-4952-8d15-3164c5f9635f] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:35.135808 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-639db866-a8e1-4470-a512-c037903a1ffe tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:35.136265 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-639db866-a8e1-4470-a512-c037903a1ffe tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:35.137028 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-639db866-a8e1-4470-a512-c037903a1ffe tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:35.137467 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-639db866-a8e1-4470-a512-c037903a1ffe tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:35.269376 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-639db866-a8e1-4470-a512-c037903a1ffe tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3954ab39014ef3819111a6fe8142b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c986ef0f5ea46f9b5e788aaca042b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:23:35.276993 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-639db866-a8e1-4470-a512-c037903a1ffe tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/f9d2fd48-b6b2-4952-8d15-3164c5f9635f" status: 200 len: 1267 microversion: 2.1 time: 0.152202 Aug 03 05:23:35.277549 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 533/1032] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:35 2022] GET /compute/v2.1/servers/f9d2fd48-b6b2-4952-8d15-3164c5f9635f => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:23:36.299026 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-e63008ac-3c4a-4245-a979-fdbbeee0c75c tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:36.299728 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-e63008ac-3c4a-4245-a979-fdbbeee0c75c tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: f9d2fd48-b6b2-4952-8d15-3164c5f9635f] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:36.306363 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e63008ac-3c4a-4245-a979-fdbbeee0c75c tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:36.306814 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e63008ac-3c4a-4245-a979-fdbbeee0c75c tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:36.307603 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e63008ac-3c4a-4245-a979-fdbbeee0c75c tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:36.308042 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e63008ac-3c4a-4245-a979-fdbbeee0c75c tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:36.440995 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-e63008ac-3c4a-4245-a979-fdbbeee0c75c tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3954ab39014ef3819111a6fe8142b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c986ef0f5ea46f9b5e788aaca042b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:23:36.448761 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-e63008ac-3c4a-4245-a979-fdbbeee0c75c tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/f9d2fd48-b6b2-4952-8d15-3164c5f9635f" status: 200 len: 1455 microversion: 2.1 time: 0.154812 Aug 03 05:23:36.449333 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 500/1033] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:36 2022] GET /compute/v2.1/servers/f9d2fd48-b6b2-4952-8d15-3164c5f9635f => generated 1455 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:23:36.469600 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-8850f72c-70dd-4687-8721-44a54d871f7d tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:36.470204 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-8850f72c-70dd-4687-8721-44a54d871f7d tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: f9d2fd48-b6b2-4952-8d15-3164c5f9635f] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:36.476636 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8850f72c-70dd-4687-8721-44a54d871f7d tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:36.477088 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8850f72c-70dd-4687-8721-44a54d871f7d tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:36.477855 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8850f72c-70dd-4687-8721-44a54d871f7d tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:36.478292 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8850f72c-70dd-4687-8721-44a54d871f7d tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:36.606293 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-8850f72c-70dd-4687-8721-44a54d871f7d tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3954ab39014ef3819111a6fe8142b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c986ef0f5ea46f9b5e788aaca042b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:23:36.613731 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-8850f72c-70dd-4687-8721-44a54d871f7d tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/f9d2fd48-b6b2-4952-8d15-3164c5f9635f" status: 200 len: 1455 microversion: 2.1 time: 0.148562 Aug 03 05:23:36.614296 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 534/1034] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:36 2022] GET /compute/v2.1/servers/f9d2fd48-b6b2-4952-8d15-3164c5f9635f => generated 1455 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:23:38.721689 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [req-eb91f17a-1941-49a3-a840-c8983a83747f req-ecc1a33c-d24c-4534-ad82-ceb43bc0276e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9d2fd48-b6b2-4952-8d15-3164c5f9635f", "tag": "4f95730f-3cba-4151-98a6-89c74a9d9cce"}]} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:23:38.731492 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-eb91f17a-1941-49a3-a840-c8983a83747f req-ecc1a33c-d24c-4534-ad82-ceb43bc0276e service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:38.732520 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-eb91f17a-1941-49a3-a840-c8983a83747f req-ecc1a33c-d24c-4534-ad82-ceb43bc0276e service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:38.743689 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.compute.server_external_events [req-eb91f17a-1941-49a3-a840-c8983a83747f req-ecc1a33c-d24c-4534-ad82-ceb43bc0276e service nova] Creating event network-changed:4f95730f-3cba-4151-98a6-89c74a9d9cce for instance f9d2fd48-b6b2-4952-8d15-3164c5f9635f on hv-cinder-85127 Aug 03 05:23:38.748955 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [req-eb91f17a-1941-49a3-a840-c8983a83747f req-ecc1a33c-d24c-4534-ad82-ceb43bc0276e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030787 Aug 03 05:23:38.749794 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 501/1035] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:23:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:24:02.226758 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-b1c825ef-e420-4d45-8cb7-b3743fc84c17 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:24:02.227512 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-b1c825ef-e420-4d45-8cb7-b3743fc84c17 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: d6b60ff4-a76f-4b50-8e1b-2b11561286b2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:24:02.229491 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_api:SELECT=9 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:24:02.230208 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=88 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:24:02.235918 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b1c825ef-e420-4d45-8cb7-b3743fc84c17 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:24:02.236376 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b1c825ef-e420-4d45-8cb7-b3743fc84c17 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:24:02.237189 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b1c825ef-e420-4d45-8cb7-b3743fc84c17 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:24:02.237589 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b1c825ef-e420-4d45-8cb7-b3743fc84c17 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:24:02.261332 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-b1c825ef-e420-4d45-8cb7-b3743fc84c17 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/d6b60ff4-a76f-4b50-8e1b-2b11561286b2/ips" status: 200 len: 148 microversion: 2.1 time: 0.039924 Aug 03 05:24:02.261910 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 535/1036] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Aug 3 05:24:02 2022] GET /compute/v2.1/servers/d6b60ff4-a76f-4b50-8e1b-2b11561286b2/ips => generated 148 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:24:03.762247 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_api:SELECT=11 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:24:03.762973 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_cell1:SELECT=44 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:24:03.767219 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-2d2379e5-bd37-4507-9562-367f2089e83c tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "40fc6d6f-30ab-46c3-afdf-8c0e98252a29"}} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:24:03.769638 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-2d2379e5-bd37-4507-9562-367f2089e83c tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: d6b60ff4-a76f-4b50-8e1b-2b11561286b2] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:24:03.775773 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-2d2379e5-bd37-4507-9562-367f2089e83c tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:24:03.776218 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-2d2379e5-bd37-4507-9562-367f2089e83c tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:24:03.776969 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-2d2379e5-bd37-4507-9562-367f2089e83c tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:24:03.777401 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-2d2379e5-bd37-4507-9562-367f2089e83c tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:24:04.458026 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-2d2379e5-bd37-4507-9562-367f2089e83c tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "POST /compute/v2.1/servers/d6b60ff4-a76f-4b50-8e1b-2b11561286b2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.697437 Aug 03 05:24:04.458568 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 502/1037] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Aug 3 05:24:03 2022] POST /compute/v2.1/servers/d6b60ff4-a76f-4b50-8e1b-2b11561286b2/os-volume_attachments => generated 194 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:24:11.978083 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-e2a11a2b-0da5-4b03-bc0a-c1aa939cef3b tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "40fc6d6f-30ab-46c3-afdf-8c0e98252a29"}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:24:11.980446 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-e2a11a2b-0da5-4b03-bc0a-c1aa939cef3b tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: d6b60ff4-a76f-4b50-8e1b-2b11561286b2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:24:11.987330 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e2a11a2b-0da5-4b03-bc0a-c1aa939cef3b tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:24:11.987790 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e2a11a2b-0da5-4b03-bc0a-c1aa939cef3b tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:24:11.988560 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e2a11a2b-0da5-4b03-bc0a-c1aa939cef3b tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:24:11.989005 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e2a11a2b-0da5-4b03-bc0a-c1aa939cef3b tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:24:12.065667 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.wsgi [None req-e2a11a2b-0da5-4b03-bc0a-c1aa939cef3b tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] HTTP exception thrown: Invalid volume: volume 40fc6d6f-30ab-46c3-afdf-8c0e98252a29 is already attached to instances: d6b60ff4-a76f-4b50-8e1b-2b11561286b2 Aug 03 05:24:12.067434 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-e2a11a2b-0da5-4b03-bc0a-c1aa939cef3b tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Request method failure captured: Aug 03 05:24:12.067434 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: request: POST /compute/v2.1/servers/d6b60ff4-a76f-4b50-8e1b-2b11561286b2/os-volume_attachments HTTP/1.1 Aug 03 05:24:12.067434 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Accept: application/json Aug 03 05:24:12.067434 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Accept-Encoding: identity Aug 03 05:24:12.067434 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Connection: close Aug 03 05:24:12.067434 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Content-Length: 74 Aug 03 05:24:12.067434 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Content-Type: application/json Aug 03 05:24:12.067434 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Host: 10.222.0.40 Aug 03 05:24:12.067434 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Openstack-System-Scope: None Aug 03 05:24:12.067434 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: User-Agent: python-urllib3/1.26.10 Aug 03 05:24:12.067434 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Auth-Token: gAAAAABi6gW1r7_81Momgb9V-Pc_vaYPdWIEuBDrgd0bdt0JL5T9I4c2oaDN-tUUEDsquQZmmEtcUgaXB4e8p9ZfKilfQ3apGdtd4ucRlv8R2i8xepw63Jaug8YDHRv4HToMeBhksVOaOx18akgjOb1gnyi4ud6p4nKX_aDqks7lJc8JWWzNrtc Aug 03 05:24:12.067434 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Domain-Id: None Aug 03 05:24:12.067434 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Domain-Name: None Aug 03 05:24:12.067434 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Identity-Status: Confirmed Aug 03 05:24:12.067434 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Is-Admin-Project: True Aug 03 05:24:12.067434 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Domain-Id: default Aug 03 05:24:12.067434 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Domain-Name: Default Aug 03 05:24:12.067434 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Id: 041a553912c64de981d9f87b551c190f Aug 03 05:24:12.067434 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Name: tempest-AttachVolumeNegativeTest-1549219107 Aug 03 05:24:12.067434 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Role: member,reader Aug 03 05:24:12.067434 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Roles: member,reader Aug 03 05:24:12.069119 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_041a553912c64de981d9f87b551c190f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/041a553912c64de981d9f87b551c190f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/041a553912c64de981d9f87b551c190f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/041a553912c64de981d9f87b551c190f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:24:12.069119 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant: tempest-AttachVolumeNegativeTest-1549219107 Aug 03 05:24:12.069119 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant-Id: 041a553912c64de981d9f87b551c190f Aug 03 05:24:12.069119 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1549219107 Aug 03 05:24:12.069119 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User: tempest-AttachVolumeNegativeTest-1549219107-project Aug 03 05:24:12.069119 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Domain-Id: default Aug 03 05:24:12.069119 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Domain-Name: Default Aug 03 05:24:12.069119 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Id: 729a6d00e1664a6298088e52de9999f5 Aug 03 05:24:12.069119 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Name: tempest-AttachVolumeNegativeTest-1549219107-project Aug 03 05:24:12.069119 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Aug 03 05:24:12.069119 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: {"volumeAttachment": {"volumeId": "40fc6d6f-30ab-46c3-afdf-8c0e98252a29"}} Aug 03 05:24:12.069119 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: method: > Aug 03 05:24:12.070285 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: exception: Invalid volume: volume 40fc6d6f-30ab-46c3-afdf-8c0e98252a29 is already attached to instances: d6b60ff4-a76f-4b50-8e1b-2b11561286b2 Aug 03 05:24:12.070285 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: action_args: {'server_id': 'd6b60ff4-a76f-4b50-8e1b-2b11561286b2', 'body': {'volumeAttachment': {'volumeId': '40fc6d6f-30ab-46c3-afdf-8c0e98252a29'}}} Aug 03 05:24:12.070285 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:24:12.070285 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:24:12.070285 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 03 05:24:12.070285 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 03 05:24:12.070285 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 05:24:12.070285 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 05:24:12.070285 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 03 05:24:12.070285 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 05:24:12.070285 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 03 05:24:12.070285 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 03 05:24:12.070285 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 03 05:24:12.070285 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 03 05:24:12.070285 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 40fc6d6f-30ab-46c3-afdf-8c0e98252a29 is already attached to instances: d6b60ff4-a76f-4b50-8e1b-2b11561286b2 Aug 03 05:24:12.070285 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:24:12.070285 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:24:12.070285 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:24:12.070285 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:24:12.071867 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:24:12.071867 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:24:12.071867 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:24:12.071867 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:24:12.071867 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:24:12.071867 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:24:12.071867 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 05:24:12.071867 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 05:24:12.071867 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 05:24:12.071867 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 05:24:12.071867 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 05:24:12.071867 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 05:24:12.071867 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 03 05:24:12.071867 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 03 05:24:12.071867 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 40fc6d6f-30ab-46c3-afdf-8c0e98252a29 is already attached to instances: d6b60ff4-a76f-4b50-8e1b-2b11561286b2 Aug 03 05:24:12.071867 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:24:12.071867 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:24:12.071867 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:24:12.071867 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:24:12.071867 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:24:12.073486 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:24:12.073486 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:24:12.073486 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:24:12.073486 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 40fc6d6f-30ab-46c3-afdf-8c0e98252a29 is already attached to instances: d6b60ff4-a76f-4b50-8e1b-2b11561286b2 Aug 03 05:24:12.073486 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:24:12.073486 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-e2a11a2b-0da5-4b03-bc0a-c1aa939cef3b tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Returning 400 to user: Invalid volume: volume 40fc6d6f-30ab-46c3-afdf-8c0e98252a29 is already attached to instances: d6b60ff4-a76f-4b50-8e1b-2b11561286b2 {{(pid=118331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:24:12.073486 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-e2a11a2b-0da5-4b03-bc0a-c1aa939cef3b tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "POST /compute/v2.1/servers/d6b60ff4-a76f-4b50-8e1b-2b11561286b2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094960 Aug 03 05:24:12.073486 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 536/1038] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Aug 3 05:24:11 2022] POST /compute/v2.1/servers/d6b60ff4-a76f-4b50-8e1b-2b11561286b2/os-volume_attachments => generated 174 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 05:24:12.133719 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-be6c577a-8d2e-471d-9761-b80ea9b2a614 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:24:12.134222 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-be6c577a-8d2e-471d-9761-b80ea9b2a614 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: d6b60ff4-a76f-4b50-8e1b-2b11561286b2] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:24:12.140458 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-be6c577a-8d2e-471d-9761-b80ea9b2a614 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:24:12.140921 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-be6c577a-8d2e-471d-9761-b80ea9b2a614 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:24:12.141722 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-be6c577a-8d2e-471d-9761-b80ea9b2a614 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:24:12.142711 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-be6c577a-8d2e-471d-9761-b80ea9b2a614 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:24:12.222169 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.objects.instance [None req-be6c577a-8d2e-471d-9761-b80ea9b2a614 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lazy-loading 'services' on Instance uuid d6b60ff4-a76f-4b50-8e1b-2b11561286b2 {{(pid=118332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:24:12.424979 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-be6c577a-8d2e-471d-9761-b80ea9b2a614 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d6b60ff4-a76f-4b50-8e1b-2b11561286b2/os-volume_attachments/40fc6d6f-30ab-46c3-afdf-8c0e98252a29" status: 202 len: 0 microversion: 2.1 time: 0.295554 Aug 03 05:24:12.425287 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 503/1039] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Aug 3 05:24:12 2022] DELETE /compute/v2.1/servers/d6b60ff4-a76f-4b50-8e1b-2b11561286b2/os-volume_attachments/40fc6d6f-30ab-46c3-afdf-8c0e98252a29 => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:24:12.434277 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-d920d8a8-0640-4233-9af8-4e5abb3e0c14 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:24:12.436566 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-d920d8a8-0640-4233-9af8-4e5abb3e0c14 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: d6b60ff4-a76f-4b50-8e1b-2b11561286b2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:24:12.444331 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d920d8a8-0640-4233-9af8-4e5abb3e0c14 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:24:12.445046 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d920d8a8-0640-4233-9af8-4e5abb3e0c14 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:24:12.445863 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d920d8a8-0640-4233-9af8-4e5abb3e0c14 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:24:12.446521 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d920d8a8-0640-4233-9af8-4e5abb3e0c14 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:24:12.476484 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-d920d8a8-0640-4233-9af8-4e5abb3e0c14 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/d6b60ff4-a76f-4b50-8e1b-2b11561286b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046129 Aug 03 05:24:12.477046 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 537/1040] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Aug 3 05:24:12 2022] GET /compute/v2.1/servers/d6b60ff4-a76f-4b50-8e1b-2b11561286b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:24:13.490198 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-a8a98ab1-c4bc-4275-802a-8f81f0396b7a tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:24:13.492647 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-a8a98ab1-c4bc-4275-802a-8f81f0396b7a tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: d6b60ff4-a76f-4b50-8e1b-2b11561286b2] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:24:13.499419 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-a8a98ab1-c4bc-4275-802a-8f81f0396b7a tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:24:13.499871 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-a8a98ab1-c4bc-4275-802a-8f81f0396b7a tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:24:13.500635 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-a8a98ab1-c4bc-4275-802a-8f81f0396b7a tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:24:13.501072 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-a8a98ab1-c4bc-4275-802a-8f81f0396b7a tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:24:13.529267 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-a8a98ab1-c4bc-4275-802a-8f81f0396b7a tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/d6b60ff4-a76f-4b50-8e1b-2b11561286b2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044093 Aug 03 05:24:13.529816 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 504/1041] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Aug 3 05:24:13 2022] GET /compute/v2.1/servers/d6b60ff4-a76f-4b50-8e1b-2b11561286b2/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 05:24:13.591934 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-2f3a7191-af68-4e5d-a028-4bff12d4ea46 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:24:13.592494 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-2f3a7191-af68-4e5d-a028-4bff12d4ea46 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: d6b60ff4-a76f-4b50-8e1b-2b11561286b2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:24:13.598979 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2f3a7191-af68-4e5d-a028-4bff12d4ea46 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:24:13.599439 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2f3a7191-af68-4e5d-a028-4bff12d4ea46 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:24:13.600213 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2f3a7191-af68-4e5d-a028-4bff12d4ea46 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:24:13.600658 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2f3a7191-af68-4e5d-a028-4bff12d4ea46 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:24:13.625669 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-2f3a7191-af68-4e5d-a028-4bff12d4ea46 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: d6b60ff4-a76f-4b50-8e1b-2b11561286b2] Going to try to terminate instance {{(pid=118331) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:24:13.934720 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-2f3a7191-af68-4e5d-a028-4bff12d4ea46 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d6b60ff4-a76f-4b50-8e1b-2b11561286b2" status: 204 len: 0 microversion: 2.1 time: 0.346258 Aug 03 05:24:13.935934 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 538/1042] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Aug 3 05:24:13 2022] DELETE /compute/v2.1/servers/d6b60ff4-a76f-4b50-8e1b-2b11561286b2 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:24:13.944255 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-cba6beb4-5e33-48c7-bead-aeeb8e7c1e35 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:24:13.945136 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-cba6beb4-5e33-48c7-bead-aeeb8e7c1e35 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: d6b60ff4-a76f-4b50-8e1b-2b11561286b2] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:24:13.951319 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-cba6beb4-5e33-48c7-bead-aeeb8e7c1e35 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:24:13.951779 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-cba6beb4-5e33-48c7-bead-aeeb8e7c1e35 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:24:13.952544 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-cba6beb4-5e33-48c7-bead-aeeb8e7c1e35 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:24:13.952987 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-cba6beb4-5e33-48c7-bead-aeeb8e7c1e35 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:24:14.085855 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-cba6beb4-5e33-48c7-bead-aeeb8e7c1e35 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729a6d00e1664a6298088e52de9999f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041a553912c64de981d9f87b551c190f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:24:14.093365 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-cba6beb4-5e33-48c7-bead-aeeb8e7c1e35 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/d6b60ff4-a76f-4b50-8e1b-2b11561286b2" status: 200 len: 1679 microversion: 2.1 time: 0.152955 Aug 03 05:24:14.093934 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 505/1043] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:24:13 2022] GET /compute/v2.1/servers/d6b60ff4-a76f-4b50-8e1b-2b11561286b2 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:24:15.115796 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-b68a7278-1d66-40d1-a7d9-133bcf0fc861 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:24:15.116492 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-b68a7278-1d66-40d1-a7d9-133bcf0fc861 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: d6b60ff4-a76f-4b50-8e1b-2b11561286b2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:24:15.123047 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b68a7278-1d66-40d1-a7d9-133bcf0fc861 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:24:15.123498 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b68a7278-1d66-40d1-a7d9-133bcf0fc861 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:24:15.124260 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b68a7278-1d66-40d1-a7d9-133bcf0fc861 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:24:15.124697 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b68a7278-1d66-40d1-a7d9-133bcf0fc861 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:24:15.255802 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-b68a7278-1d66-40d1-a7d9-133bcf0fc861 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729a6d00e1664a6298088e52de9999f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041a553912c64de981d9f87b551c190f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:24:15.263265 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-b68a7278-1d66-40d1-a7d9-133bcf0fc861 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/d6b60ff4-a76f-4b50-8e1b-2b11561286b2" status: 200 len: 1679 microversion: 2.1 time: 0.152317 Aug 03 05:24:15.263865 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 539/1044] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:24:15 2022] GET /compute/v2.1/servers/d6b60ff4-a76f-4b50-8e1b-2b11561286b2 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:24:16.285223 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-aee2c2b1-58b6-4708-9d89-5bf5d2834c2f tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:24:16.286074 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-aee2c2b1-58b6-4708-9d89-5bf5d2834c2f tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: d6b60ff4-a76f-4b50-8e1b-2b11561286b2] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:24:16.293324 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-aee2c2b1-58b6-4708-9d89-5bf5d2834c2f tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:24:16.293846 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-aee2c2b1-58b6-4708-9d89-5bf5d2834c2f tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:24:16.294697 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-aee2c2b1-58b6-4708-9d89-5bf5d2834c2f tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:24:16.295259 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-aee2c2b1-58b6-4708-9d89-5bf5d2834c2f tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:24:16.370103 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-aee2c2b1-58b6-4708-9d89-5bf5d2834c2f tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729a6d00e1664a6298088e52de9999f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041a553912c64de981d9f87b551c190f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:24:16.383422 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-da14bb31-aeb4-44c6-9b55-825d06b02907 req-99e6e9b1-0432-4da4-ab72-9cbb7939874b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6b60ff4-a76f-4b50-8e1b-2b11561286b2", "name": "network-vif-deleted", "tag": "6bc0e545-9f39-46f2-8635-27046794f1cd"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:24:16.390624 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-aee2c2b1-58b6-4708-9d89-5bf5d2834c2f tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/d6b60ff4-a76f-4b50-8e1b-2b11561286b2" status: 200 len: 1612 microversion: 2.1 time: 0.109211 Aug 03 05:24:16.391850 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 506/1045] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:24:16 2022] GET /compute/v2.1/servers/d6b60ff4-a76f-4b50-8e1b-2b11561286b2 => generated 1612 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:24:16.401064 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-da14bb31-aeb4-44c6-9b55-825d06b02907 req-99e6e9b1-0432-4da4-ab72-9cbb7939874b service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:24:16.401775 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-da14bb31-aeb4-44c6-9b55-825d06b02907 req-99e6e9b1-0432-4da4-ab72-9cbb7939874b service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:24:16.415307 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-da14bb31-aeb4-44c6-9b55-825d06b02907 req-99e6e9b1-0432-4da4-ab72-9cbb7939874b service nova] Creating event network-vif-deleted:6bc0e545-9f39-46f2-8635-27046794f1cd for instance d6b60ff4-a76f-4b50-8e1b-2b11561286b2 on hv-cinder-85127 Aug 03 05:24:16.421265 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-da14bb31-aeb4-44c6-9b55-825d06b02907 req-99e6e9b1-0432-4da4-ab72-9cbb7939874b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118447 Aug 03 05:24:16.422077 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 540/1046] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:24:17.416661 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-f9a131ad-081b-4bde-902a-50088c2afb22 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:24:17.417311 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-f9a131ad-081b-4bde-902a-50088c2afb22 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: d6b60ff4-a76f-4b50-8e1b-2b11561286b2] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:24:17.424140 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f9a131ad-081b-4bde-902a-50088c2afb22 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:24:17.424604 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f9a131ad-081b-4bde-902a-50088c2afb22 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:24:17.425397 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f9a131ad-081b-4bde-902a-50088c2afb22 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:24:17.425864 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f9a131ad-081b-4bde-902a-50088c2afb22 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:24:17.448126 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.wsgi [None req-f9a131ad-081b-4bde-902a-50088c2afb22 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] HTTP exception thrown: Instance d6b60ff4-a76f-4b50-8e1b-2b11561286b2 could not be found. Aug 03 05:24:17.449739 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-f9a131ad-081b-4bde-902a-50088c2afb22 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Request method failure captured: Aug 03 05:24:17.449739 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: request: GET /compute/v2.1/servers/d6b60ff4-a76f-4b50-8e1b-2b11561286b2 HTTP/1.1 Aug 03 05:24:17.449739 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Accept: application/json Aug 03 05:24:17.449739 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Accept-Encoding: identity Aug 03 05:24:17.449739 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Connection: close Aug 03 05:24:17.449739 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Content-Length: 0 Aug 03 05:24:17.449739 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Content-Type: application/json Aug 03 05:24:17.449739 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Host: 10.222.0.40 Aug 03 05:24:17.449739 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Openstack-System-Scope: None Aug 03 05:24:17.449739 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: User-Agent: python-urllib3/1.26.10 Aug 03 05:24:17.449739 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Auth-Token: gAAAAABi6gW1r7_81Momgb9V-Pc_vaYPdWIEuBDrgd0bdt0JL5T9I4c2oaDN-tUUEDsquQZmmEtcUgaXB4e8p9ZfKilfQ3apGdtd4ucRlv8R2i8xepw63Jaug8YDHRv4HToMeBhksVOaOx18akgjOb1gnyi4ud6p4nKX_aDqks7lJc8JWWzNrtc Aug 03 05:24:17.449739 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Domain-Id: None Aug 03 05:24:17.449739 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Domain-Name: None Aug 03 05:24:17.449739 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Identity-Status: Confirmed Aug 03 05:24:17.449739 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Is-Admin-Project: True Aug 03 05:24:17.449739 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Domain-Id: default Aug 03 05:24:17.449739 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Domain-Name: Default Aug 03 05:24:17.449739 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Id: 041a553912c64de981d9f87b551c190f Aug 03 05:24:17.449739 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Name: tempest-AttachVolumeNegativeTest-1549219107 Aug 03 05:24:17.449739 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Role: member,reader Aug 03 05:24:17.449739 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Roles: member,reader Aug 03 05:24:17.451403 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_041a553912c64de981d9f87b551c190f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/041a553912c64de981d9f87b551c190f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/041a553912c64de981d9f87b551c190f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/041a553912c64de981d9f87b551c190f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:24:17.451403 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant: tempest-AttachVolumeNegativeTest-1549219107 Aug 03 05:24:17.451403 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant-Id: 041a553912c64de981d9f87b551c190f Aug 03 05:24:17.451403 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1549219107 Aug 03 05:24:17.451403 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User: tempest-AttachVolumeNegativeTest-1549219107-project Aug 03 05:24:17.451403 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Domain-Id: default Aug 03 05:24:17.451403 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Domain-Name: Default Aug 03 05:24:17.451403 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Id: 729a6d00e1664a6298088e52de9999f5 Aug 03 05:24:17.451403 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Name: tempest-AttachVolumeNegativeTest-1549219107-project Aug 03 05:24:17.451403 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: method: > Aug 03 05:24:17.451403 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: exception: Instance d6b60ff4-a76f-4b50-8e1b-2b11561286b2 could not be found. Aug 03 05:24:17.451403 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: action_args: {'id': 'd6b60ff4-a76f-4b50-8e1b-2b11561286b2'} Aug 03 05:24:17.452594 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:24:17.452594 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:24:17.452594 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:24:17.452594 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:24:17.452594 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:24:17.452594 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:24:17.452594 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:24:17.452594 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:24:17.452594 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:24:17.452594 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:24:17.452594 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6b60ff4-a76f-4b50-8e1b-2b11561286b2 could not be found. Aug 03 05:24:17.452594 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:24:17.452594 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:24:17.452594 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:24:17.452594 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:24:17.452594 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:24:17.452594 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:24:17.452594 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:24:17.452594 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:24:17.452594 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:24:17.455055 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:24:17.455055 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:24:17.455055 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:24:17.455055 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:24:17.455055 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:24:17.455055 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:24:17.455055 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:24:17.455055 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6b60ff4-a76f-4b50-8e1b-2b11561286b2 could not be found. Aug 03 05:24:17.455055 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:24:17.455055 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:24:17.455055 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:24:17.455055 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:24:17.455055 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:24:17.455055 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:24:17.455055 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:24:17.455055 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:24:17.455055 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6b60ff4-a76f-4b50-8e1b-2b11561286b2 could not be found. Aug 03 05:24:17.455055 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:24:17.458496 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-f9a131ad-081b-4bde-902a-50088c2afb22 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Returning 404 to user: Instance d6b60ff4-a76f-4b50-8e1b-2b11561286b2 could not be found. {{(pid=118332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:24:17.458496 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-f9a131ad-081b-4bde-902a-50088c2afb22 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/d6b60ff4-a76f-4b50-8e1b-2b11561286b2" status: 404 len: 111 microversion: 2.1 time: 0.041292 Aug 03 05:24:17.458496 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 507/1047] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:24:17 2022] GET /compute/v2.1/servers/d6b60ff4-a76f-4b50-8e1b-2b11561286b2 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:24:17.462797 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-dcbbf39e-d946-442d-8080-bf64f2efbdef tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '.version_select at 0x7f7601f6a3a0>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:24:17.536111 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-dcbbf39e-d946-442d-8080-bf64f2efbdef tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-515031498" status: 202 len: 0 microversion: 2.1 time: 0.078750 Aug 03 05:24:17.538801 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 541/1048] 10.222.0.40 () {58 vars in 1218 bytes} [Wed Aug 3 05:24:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-515031498 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:24:18.322466 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-5fe1c1b0-37d6-4991-96dd-7699c9b88e3a tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Action: 'create', calling method: .version_select at 0x7f7601e73d30>, body: {"keypair": {"name": "tempest-keypair-1545770912", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBISChq1AkbY5p2y86sinXyIAt2haJXJmdzEDdh6E21NsTY8sKFZBZViPGxT8unZKeseoF5eWhYjQMn499QoWylzHoR6LckG9i9/GBYRmc/kBmRosGIDL1ir1oHqCQJH5hQ=="}} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:24:18.337776 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.quota [None req-5fe1c1b0-37d6-4991-96dd-7699c9b88e3a tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Getting quotas for project 041a553912c64de981d9f87b551c190f. Resources: {'key_pairs'} {{(pid=118332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:24:18.341653 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.quota [None req-5fe1c1b0-37d6-4991-96dd-7699c9b88e3a tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Getting quotas for user 729a6d00e1664a6298088e52de9999f5 and project 041a553912c64de981d9f87b551c190f. Resources: {'key_pairs'} {{(pid=118332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:24:18.420838 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-5fe1c1b0-37d6-4991-96dd-7699c9b88e3a tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.102612 Aug 03 05:24:18.421499 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 508/1049] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Aug 3 05:24:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:24:20.441747 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-956855c1-3b99-4f05-ab1a-ab311c423d4c tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-237905244", "imageRef": "37d7ad4a-d925-48e6-84af-ec878f19050e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a2df47b9-9137-4503-88b3-7af6200f8ad6"}], "security_groups": [{"name": "tempest-securitygroup--2130040277"}], "key_name": "tempest-keypair-1545770912", "user_data": "}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:24:20.547051 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.network.neutron [None req-956855c1-3b99-4f05-ab1a-ab311c423d4c tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] validate_networks() for [('a2df47b9-9137-4503-88b3-7af6200f8ad6', None, None, None, None, None)] {{(pid=118331) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:24:20.934132 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-956855c1-3b99-4f05-ab1a-ab311c423d4c tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Flavor limits 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:24:20.934560 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-956855c1-3b99-4f05-ab1a-ab311c423d4c tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Image limits 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:24:20.935096 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-956855c1-3b99-4f05-ab1a-ab311c423d4c tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Flavor pref 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:24:20.935507 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-956855c1-3b99-4f05-ab1a-ab311c423d4c tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Image pref 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:24:20.935921 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-956855c1-3b99-4f05-ab1a-ab311c423d4c tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:24:20.945433 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-956855c1-3b99-4f05-ab1a-ab311c423d4c tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:24:20.945877 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-956855c1-3b99-4f05-ab1a-ab311c423d4c tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:24:20.946667 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-956855c1-3b99-4f05-ab1a-ab311c423d4c tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:24:20.947134 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-956855c1-3b99-4f05-ab1a-ab311c423d4c tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:24:20.964390 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-956855c1-3b99-4f05-ab1a-ab311c423d4c tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Getting quotas for project 041a553912c64de981d9f87b551c190f. Resources: {'instances', 'ram', 'cores'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:24:20.968282 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-956855c1-3b99-4f05-ab1a-ab311c423d4c tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Getting quotas for user 729a6d00e1664a6298088e52de9999f5 and project 041a553912c64de981d9f87b551c190f. Resources: {'instances', 'ram', 'cores'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:24:20.979463 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-956855c1-3b99-4f05-ab1a-ab311c423d4c tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Going to run 1 instances... {{(pid=118331) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:24:20.981874 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-956855c1-3b99-4f05-ab1a-ab311c423d4c tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 4ec3db0e-4592-4839-b939-de6f7b4ad37c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37d7ad4a-d925-48e6-84af-ec878f19050e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:24:21.096489 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-956855c1-3b99-4f05-ab1a-ab311c423d4c tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.659280 Aug 03 05:24:21.097124 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 542/1050] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Aug 3 05:24:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 05:24:21.108820 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-6bc2b1a1-6497-45ce-93bb-74df2be3431a tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:24:21.109441 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-6bc2b1a1-6497-45ce-93bb-74df2be3431a tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 4ec3db0e-4592-4839-b939-de6f7b4ad37c] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:24:21.165027 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-6bc2b1a1-6497-45ce-93bb-74df2be3431a tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729a6d00e1664a6298088e52de9999f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041a553912c64de981d9f87b551c190f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:24:21.171771 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-6bc2b1a1-6497-45ce-93bb-74df2be3431a tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/4ec3db0e-4592-4839-b939-de6f7b4ad37c" status: 200 len: 1241 microversion: 2.1 time: 0.067431 Aug 03 05:24:21.172339 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 509/1051] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:24:21 2022] GET /compute/v2.1/servers/4ec3db0e-4592-4839-b939-de6f7b4ad37c => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:24:22.194311 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-79e4c1e4-7f78-4e58-88f7-b51a7aff908f tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:24:22.194969 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-79e4c1e4-7f78-4e58-88f7-b51a7aff908f tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 4ec3db0e-4592-4839-b939-de6f7b4ad37c] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:24:22.201328 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-79e4c1e4-7f78-4e58-88f7-b51a7aff908f tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:24:22.201779 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-79e4c1e4-7f78-4e58-88f7-b51a7aff908f tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:24:22.202587 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-79e4c1e4-7f78-4e58-88f7-b51a7aff908f tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:24:22.203063 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-79e4c1e4-7f78-4e58-88f7-b51a7aff908f tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:24:22.270347 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-79e4c1e4-7f78-4e58-88f7-b51a7aff908f tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729a6d00e1664a6298088e52de9999f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041a553912c64de981d9f87b551c190f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:24:22.277855 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-79e4c1e4-7f78-4e58-88f7-b51a7aff908f tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/4ec3db0e-4592-4839-b939-de6f7b4ad37c" status: 200 len: 1237 microversion: 2.1 time: 0.088175 Aug 03 05:24:22.278427 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 543/1052] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:24:22 2022] GET /compute/v2.1/servers/4ec3db0e-4592-4839-b939-de6f7b4ad37c => generated 1237 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:24:23.299565 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-4221a6a1-eb87-4554-832a-e9e4ff25d987 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:24:23.300792 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-4221a6a1-eb87-4554-832a-e9e4ff25d987 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 4ec3db0e-4592-4839-b939-de6f7b4ad37c] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:24:23.309777 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-4221a6a1-eb87-4554-832a-e9e4ff25d987 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:24:23.310180 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-4221a6a1-eb87-4554-832a-e9e4ff25d987 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:24:23.311330 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-4221a6a1-eb87-4554-832a-e9e4ff25d987 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:24:23.312079 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-4221a6a1-eb87-4554-832a-e9e4ff25d987 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:24:23.396674 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-4221a6a1-eb87-4554-832a-e9e4ff25d987 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729a6d00e1664a6298088e52de9999f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041a553912c64de981d9f87b551c190f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:24:23.409328 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-4221a6a1-eb87-4554-832a-e9e4ff25d987 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/4ec3db0e-4592-4839-b939-de6f7b4ad37c" status: 200 len: 1299 microversion: 2.1 time: 0.114344 Aug 03 05:24:23.410805 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 510/1053] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:24:23 2022] GET /compute/v2.1/servers/4ec3db0e-4592-4839-b939-de6f7b4ad37c => generated 1299 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:24:24.408592 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-fd238db6-fed1-4449-a1e7-3f16a9f6003a req-ddd43ac9-53ff-4c32-8a73-b39d7f578fe9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ec3db0e-4592-4839-b939-de6f7b4ad37c", "tag": "89990246-38c7-461e-972a-0827c62a30f6"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:24:24.419434 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-fd238db6-fed1-4449-a1e7-3f16a9f6003a req-ddd43ac9-53ff-4c32-8a73-b39d7f578fe9 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:24:24.419930 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-fd238db6-fed1-4449-a1e7-3f16a9f6003a req-ddd43ac9-53ff-4c32-8a73-b39d7f578fe9 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:24:24.430951 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-fd238db6-fed1-4449-a1e7-3f16a9f6003a req-ddd43ac9-53ff-4c32-8a73-b39d7f578fe9 service nova] Creating event network-changed:89990246-38c7-461e-972a-0827c62a30f6 for instance 4ec3db0e-4592-4839-b939-de6f7b4ad37c on hv-cinder-85127 Aug 03 05:24:24.433457 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-8ba258d9-e373-46b5-9535-95d59c8e0f20 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:24:24.434093 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-8ba258d9-e373-46b5-9535-95d59c8e0f20 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 4ec3db0e-4592-4839-b939-de6f7b4ad37c] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:24:24.439668 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-fd238db6-fed1-4449-a1e7-3f16a9f6003a req-ddd43ac9-53ff-4c32-8a73-b39d7f578fe9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034942 Aug 03 05:24:24.440533 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 544/1054] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:24:24.441392 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-8ba258d9-e373-46b5-9535-95d59c8e0f20 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:24:24.441852 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-8ba258d9-e373-46b5-9535-95d59c8e0f20 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:24:24.442642 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-8ba258d9-e373-46b5-9535-95d59c8e0f20 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:24:24.443118 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-8ba258d9-e373-46b5-9535-95d59c8e0f20 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:24:24.909633 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-8ba258d9-e373-46b5-9535-95d59c8e0f20 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729a6d00e1664a6298088e52de9999f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041a553912c64de981d9f87b551c190f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:24:24.917475 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-8ba258d9-e373-46b5-9535-95d59c8e0f20 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/4ec3db0e-4592-4839-b939-de6f7b4ad37c" status: 200 len: 1367 microversion: 2.1 time: 0.487789 Aug 03 05:24:24.918056 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 511/1055] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:24:24 2022] GET /compute/v2.1/servers/4ec3db0e-4592-4839-b939-de6f7b4ad37c => generated 1367 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:24:25.939784 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-c6587d82-0f69-4ea7-81ee-aa75da9a0e52 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:24:25.940385 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-c6587d82-0f69-4ea7-81ee-aa75da9a0e52 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 4ec3db0e-4592-4839-b939-de6f7b4ad37c] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:24:25.947009 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c6587d82-0f69-4ea7-81ee-aa75da9a0e52 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:24:25.947459 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c6587d82-0f69-4ea7-81ee-aa75da9a0e52 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:24:25.948211 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c6587d82-0f69-4ea7-81ee-aa75da9a0e52 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:24:25.948647 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c6587d82-0f69-4ea7-81ee-aa75da9a0e52 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:24:26.080982 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-c6587d82-0f69-4ea7-81ee-aa75da9a0e52 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729a6d00e1664a6298088e52de9999f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041a553912c64de981d9f87b551c190f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:24:26.088378 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-c6587d82-0f69-4ea7-81ee-aa75da9a0e52 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/4ec3db0e-4592-4839-b939-de6f7b4ad37c" status: 200 len: 1367 microversion: 2.1 time: 0.153875 Aug 03 05:24:26.088973 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 545/1056] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:24:25 2022] GET /compute/v2.1/servers/4ec3db0e-4592-4839-b939-de6f7b4ad37c => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:24:27.109041 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-5d13c8a1-5b56-4f40-91a2-54633ce9e245 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:24:27.109680 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-5d13c8a1-5b56-4f40-91a2-54633ce9e245 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 4ec3db0e-4592-4839-b939-de6f7b4ad37c] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:24:27.116743 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-5d13c8a1-5b56-4f40-91a2-54633ce9e245 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:24:27.117194 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-5d13c8a1-5b56-4f40-91a2-54633ce9e245 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:24:27.117957 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-5d13c8a1-5b56-4f40-91a2-54633ce9e245 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:24:27.118395 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-5d13c8a1-5b56-4f40-91a2-54633ce9e245 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:24:27.245898 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-5d13c8a1-5b56-4f40-91a2-54633ce9e245 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729a6d00e1664a6298088e52de9999f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041a553912c64de981d9f87b551c190f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:24:27.254208 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-5d13c8a1-5b56-4f40-91a2-54633ce9e245 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/4ec3db0e-4592-4839-b939-de6f7b4ad37c" status: 200 len: 1367 microversion: 2.1 time: 0.148998 Aug 03 05:24:27.254778 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 512/1057] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:24:27 2022] GET /compute/v2.1/servers/4ec3db0e-4592-4839-b939-de6f7b4ad37c => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:24:28.275146 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-2960c530-fa7c-4191-8f6b-6198197cfe06 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:24:28.275766 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-2960c530-fa7c-4191-8f6b-6198197cfe06 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 4ec3db0e-4592-4839-b939-de6f7b4ad37c] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:24:28.282972 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2960c530-fa7c-4191-8f6b-6198197cfe06 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:24:28.283422 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2960c530-fa7c-4191-8f6b-6198197cfe06 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:24:28.284202 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2960c530-fa7c-4191-8f6b-6198197cfe06 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:24:28.284639 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2960c530-fa7c-4191-8f6b-6198197cfe06 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:24:28.423588 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-2960c530-fa7c-4191-8f6b-6198197cfe06 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729a6d00e1664a6298088e52de9999f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041a553912c64de981d9f87b551c190f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:24:28.431108 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-2960c530-fa7c-4191-8f6b-6198197cfe06 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/4ec3db0e-4592-4839-b939-de6f7b4ad37c" status: 200 len: 1367 microversion: 2.1 time: 0.160076 Aug 03 05:24:28.431672 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 546/1058] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:24:28 2022] GET /compute/v2.1/servers/4ec3db0e-4592-4839-b939-de6f7b4ad37c => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:24:29.452013 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-74959c93-fb7a-43ee-b677-a3a6371a706d tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:24:29.452611 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-74959c93-fb7a-43ee-b677-a3a6371a706d tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 4ec3db0e-4592-4839-b939-de6f7b4ad37c] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:24:29.459895 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-74959c93-fb7a-43ee-b677-a3a6371a706d tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:24:29.460343 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-74959c93-fb7a-43ee-b677-a3a6371a706d tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:24:29.461106 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-74959c93-fb7a-43ee-b677-a3a6371a706d tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:24:29.461545 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-74959c93-fb7a-43ee-b677-a3a6371a706d tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:24:29.600016 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-74959c93-fb7a-43ee-b677-a3a6371a706d tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729a6d00e1664a6298088e52de9999f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041a553912c64de981d9f87b551c190f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:24:29.607426 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-74959c93-fb7a-43ee-b677-a3a6371a706d tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/4ec3db0e-4592-4839-b939-de6f7b4ad37c" status: 200 len: 1367 microversion: 2.1 time: 0.159334 Aug 03 05:24:29.607993 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 513/1059] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:24:29 2022] GET /compute/v2.1/servers/4ec3db0e-4592-4839-b939-de6f7b4ad37c => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:24:30.628227 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-e8677810-ce7a-4d91-bbba-122440f2406e tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:24:30.628948 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-e8677810-ce7a-4d91-bbba-122440f2406e tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 4ec3db0e-4592-4839-b939-de6f7b4ad37c] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:24:30.635542 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e8677810-ce7a-4d91-bbba-122440f2406e tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:24:30.636008 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e8677810-ce7a-4d91-bbba-122440f2406e tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:24:30.636790 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e8677810-ce7a-4d91-bbba-122440f2406e tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:24:30.637236 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e8677810-ce7a-4d91-bbba-122440f2406e tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:24:30.775284 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-e8677810-ce7a-4d91-bbba-122440f2406e tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729a6d00e1664a6298088e52de9999f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041a553912c64de981d9f87b551c190f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:24:30.783557 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-e8677810-ce7a-4d91-bbba-122440f2406e tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/4ec3db0e-4592-4839-b939-de6f7b4ad37c" status: 200 len: 1367 microversion: 2.1 time: 0.159218 Aug 03 05:24:30.784175 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 547/1060] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:24:30 2022] GET /compute/v2.1/servers/4ec3db0e-4592-4839-b939-de6f7b4ad37c => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:24:30.857401 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [req-ce37ada0-dcce-43ed-87d3-742374f80501 req-aeefe328-4b21-4d74-841e-255eb372ea1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ec3db0e-4592-4839-b939-de6f7b4ad37c", "name": "network-vif-plugged", "status": "completed", "tag": "89990246-38c7-461e-972a-0827c62a30f6"}]} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:24:30.867255 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-ce37ada0-dcce-43ed-87d3-742374f80501 req-aeefe328-4b21-4d74-841e-255eb372ea1c service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:24:30.867708 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-ce37ada0-dcce-43ed-87d3-742374f80501 req-aeefe328-4b21-4d74-841e-255eb372ea1c service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:24:30.878764 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.compute.server_external_events [req-ce37ada0-dcce-43ed-87d3-742374f80501 req-aeefe328-4b21-4d74-841e-255eb372ea1c service nova] Creating event network-vif-plugged:89990246-38c7-461e-972a-0827c62a30f6 for instance 4ec3db0e-4592-4839-b939-de6f7b4ad37c on hv-cinder-85127 Aug 03 05:24:30.883883 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [req-ce37ada0-dcce-43ed-87d3-742374f80501 req-aeefe328-4b21-4d74-841e-255eb372ea1c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084814 Aug 03 05:24:30.884498 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 514/1061] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:24:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:24:31.805164 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-983529ab-2ae2-40da-ac44-2bf04e52345d tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:24:31.805748 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-983529ab-2ae2-40da-ac44-2bf04e52345d tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 4ec3db0e-4592-4839-b939-de6f7b4ad37c] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:24:31.807699 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell0:SELECT=2 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:24:31.808372 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell0:SELECT=6 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:24:31.813757 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-983529ab-2ae2-40da-ac44-2bf04e52345d tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:24:31.814691 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-983529ab-2ae2-40da-ac44-2bf04e52345d tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:24:31.815495 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-983529ab-2ae2-40da-ac44-2bf04e52345d tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:24:31.815943 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-983529ab-2ae2-40da-ac44-2bf04e52345d tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:24:31.944761 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-983529ab-2ae2-40da-ac44-2bf04e52345d tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729a6d00e1664a6298088e52de9999f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041a553912c64de981d9f87b551c190f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:24:31.952108 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-983529ab-2ae2-40da-ac44-2bf04e52345d tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/4ec3db0e-4592-4839-b939-de6f7b4ad37c" status: 200 len: 1367 microversion: 2.1 time: 0.150857 Aug 03 05:24:31.959303 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 548/1062] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:24:31 2022] GET /compute/v2.1/servers/4ec3db0e-4592-4839-b939-de6f7b4ad37c => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:24:32.970485 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_cell0:SELECT=6 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:24:32.975092 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-9a715d87-c0e6-4587-826d-3e55b77bd5a7 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:24:32.975800 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-9a715d87-c0e6-4587-826d-3e55b77bd5a7 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 4ec3db0e-4592-4839-b939-de6f7b4ad37c] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:24:32.981983 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-9a715d87-c0e6-4587-826d-3e55b77bd5a7 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:24:32.982437 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-9a715d87-c0e6-4587-826d-3e55b77bd5a7 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:24:32.983252 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-9a715d87-c0e6-4587-826d-3e55b77bd5a7 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:24:32.983698 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-9a715d87-c0e6-4587-826d-3e55b77bd5a7 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:24:33.130314 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-9a715d87-c0e6-4587-826d-3e55b77bd5a7 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729a6d00e1664a6298088e52de9999f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041a553912c64de981d9f87b551c190f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:24:33.130314 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-9a715d87-c0e6-4587-826d-3e55b77bd5a7 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/4ec3db0e-4592-4839-b939-de6f7b4ad37c" status: 200 len: 1556 microversion: 2.1 time: 0.155573 Aug 03 05:24:33.130314 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 515/1063] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:24:32 2022] GET /compute/v2.1/servers/4ec3db0e-4592-4839-b939-de6f7b4ad37c => generated 1556 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:24:33.146352 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-e85ef779-2844-4324-bd0b-966ad08e8145 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:24:33.147020 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-e85ef779-2844-4324-bd0b-966ad08e8145 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 4ec3db0e-4592-4839-b939-de6f7b4ad37c] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:24:33.153539 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e85ef779-2844-4324-bd0b-966ad08e8145 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:24:33.153992 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e85ef779-2844-4324-bd0b-966ad08e8145 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:24:33.154757 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e85ef779-2844-4324-bd0b-966ad08e8145 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:24:33.155226 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e85ef779-2844-4324-bd0b-966ad08e8145 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:24:33.231282 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-e85ef779-2844-4324-bd0b-966ad08e8145 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/4ec3db0e-4592-4839-b939-de6f7b4ad37c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088922 Aug 03 05:24:33.231965 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 549/1064] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Aug 3 05:24:33 2022] GET /compute/v2.1/servers/4ec3db0e-4592-4839-b939-de6f7b4ad37c/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:24:34.442066 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [req-8827366e-32f5-4e10-a400-5eee76761975 req-00ac10f4-4a8c-45f5-84c5-2a445eab6861 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ec3db0e-4592-4839-b939-de6f7b4ad37c", "tag": "89990246-38c7-461e-972a-0827c62a30f6"}]} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:24:34.447893 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:24:34.453344 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-8827366e-32f5-4e10-a400-5eee76761975 req-00ac10f4-4a8c-45f5-84c5-2a445eab6861 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:24:34.457046 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-8827366e-32f5-4e10-a400-5eee76761975 req-00ac10f4-4a8c-45f5-84c5-2a445eab6861 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:24:34.458164 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:24:34.465520 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.compute.server_external_events [req-8827366e-32f5-4e10-a400-5eee76761975 req-00ac10f4-4a8c-45f5-84c5-2a445eab6861 service nova] Creating event network-changed:89990246-38c7-461e-972a-0827c62a30f6 for instance 4ec3db0e-4592-4839-b939-de6f7b4ad37c on hv-cinder-85127 Aug 03 05:24:34.470353 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [req-8827366e-32f5-4e10-a400-5eee76761975 req-00ac10f4-4a8c-45f5-84c5-2a445eab6861 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031945 Aug 03 05:24:34.471734 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 516/1065] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:24:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:25:09.260273 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:25:09.261021 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:25:09.264848 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-7c879795-363e-4843-b957-88920e8272e2 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:25:09.265336 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-7c879795-363e-4843-b957-88920e8272e2 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 4ec3db0e-4592-4839-b939-de6f7b4ad37c] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:25:09.271205 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7c879795-363e-4843-b957-88920e8272e2 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:09.272587 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7c879795-363e-4843-b957-88920e8272e2 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:09.272587 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7c879795-363e-4843-b957-88920e8272e2 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:09.272791 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7c879795-363e-4843-b957-88920e8272e2 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:09.295757 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-7c879795-363e-4843-b957-88920e8272e2 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/4ec3db0e-4592-4839-b939-de6f7b4ad37c/ips" status: 200 len: 149 microversion: 2.1 time: 0.036942 Aug 03 05:25:09.301971 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 550/1066] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Aug 3 05:25:09 2022] GET /compute/v2.1/servers/4ec3db0e-4592-4839-b939-de6f7b4ad37c/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:25:10.842283 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-9a3b0e94-2778-4fb3-8433-5a736c8db96e tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "78f4cf9f-faba-4bcd-9eea-d23638ab102f"}} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:25:10.848556 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-9a3b0e94-2778-4fb3-8433-5a736c8db96e tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 4ec3db0e-4592-4839-b939-de6f7b4ad37c] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:25:10.852312 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-9a3b0e94-2778-4fb3-8433-5a736c8db96e tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:10.852761 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-9a3b0e94-2778-4fb3-8433-5a736c8db96e tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:10.853531 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-9a3b0e94-2778-4fb3-8433-5a736c8db96e tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:10.853968 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-9a3b0e94-2778-4fb3-8433-5a736c8db96e tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:11.478416 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-9a3b0e94-2778-4fb3-8433-5a736c8db96e tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "POST /compute/v2.1/servers/4ec3db0e-4592-4839-b939-de6f7b4ad37c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.641706 Aug 03 05:25:11.479053 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 517/1067] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Aug 3 05:25:10 2022] POST /compute/v2.1/servers/4ec3db0e-4592-4839-b939-de6f7b4ad37c/os-volume_attachments => generated 194 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:25:19.108240 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-568718f5-e7a0-40d6-be1f-289c79641496 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:25:19.108797 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-568718f5-e7a0-40d6-be1f-289c79641496 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 4ec3db0e-4592-4839-b939-de6f7b4ad37c] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:25:19.116935 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-568718f5-e7a0-40d6-be1f-289c79641496 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:19.117551 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-568718f5-e7a0-40d6-be1f-289c79641496 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:19.119381 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-568718f5-e7a0-40d6-be1f-289c79641496 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:19.119860 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-568718f5-e7a0-40d6-be1f-289c79641496 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:19.206324 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.objects.instance [None req-568718f5-e7a0-40d6-be1f-289c79641496 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lazy-loading 'services' on Instance uuid 4ec3db0e-4592-4839-b939-de6f7b4ad37c {{(pid=118331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:25:19.371151 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-568718f5-e7a0-40d6-be1f-289c79641496 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4ec3db0e-4592-4839-b939-de6f7b4ad37c/os-volume_attachments/78f4cf9f-faba-4bcd-9eea-d23638ab102f" status: 202 len: 0 microversion: 2.1 time: 0.266667 Aug 03 05:25:19.371749 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 551/1068] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Aug 3 05:25:19 2022] DELETE /compute/v2.1/servers/4ec3db0e-4592-4839-b939-de6f7b4ad37c/os-volume_attachments/78f4cf9f-faba-4bcd-9eea-d23638ab102f => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 05:25:19.384925 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-06fed01c-97d1-49c0-b12b-e3fcb5e33a38 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:25:19.388007 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-06fed01c-97d1-49c0-b12b-e3fcb5e33a38 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 4ec3db0e-4592-4839-b939-de6f7b4ad37c] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:25:19.398163 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-06fed01c-97d1-49c0-b12b-e3fcb5e33a38 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:19.399669 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-06fed01c-97d1-49c0-b12b-e3fcb5e33a38 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:19.400076 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-06fed01c-97d1-49c0-b12b-e3fcb5e33a38 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:19.400720 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-06fed01c-97d1-49c0-b12b-e3fcb5e33a38 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:19.432794 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-06fed01c-97d1-49c0-b12b-e3fcb5e33a38 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/4ec3db0e-4592-4839-b939-de6f7b4ad37c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056175 Aug 03 05:25:19.433320 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 518/1069] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Aug 3 05:25:19 2022] GET /compute/v2.1/servers/4ec3db0e-4592-4839-b939-de6f7b4ad37c/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:25:20.447145 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-a15c900b-fedc-444f-9eb0-fe76786f09cf tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:25:20.449484 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-a15c900b-fedc-444f-9eb0-fe76786f09cf tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 4ec3db0e-4592-4839-b939-de6f7b4ad37c] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:25:20.455755 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a15c900b-fedc-444f-9eb0-fe76786f09cf tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:20.456204 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a15c900b-fedc-444f-9eb0-fe76786f09cf tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:20.457664 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a15c900b-fedc-444f-9eb0-fe76786f09cf tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:20.458099 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a15c900b-fedc-444f-9eb0-fe76786f09cf tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:20.485880 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-a15c900b-fedc-444f-9eb0-fe76786f09cf tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/4ec3db0e-4592-4839-b939-de6f7b4ad37c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044402 Aug 03 05:25:20.486490 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 552/1070] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Aug 3 05:25:20 2022] GET /compute/v2.1/servers/4ec3db0e-4592-4839-b939-de6f7b4ad37c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:25:21.497720 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-9965370f-5251-4486-9fa1-7e0c6ab9dbc0 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:25:21.500079 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-9965370f-5251-4486-9fa1-7e0c6ab9dbc0 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 4ec3db0e-4592-4839-b939-de6f7b4ad37c] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:25:21.506674 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-9965370f-5251-4486-9fa1-7e0c6ab9dbc0 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:21.507183 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-9965370f-5251-4486-9fa1-7e0c6ab9dbc0 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:21.507950 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-9965370f-5251-4486-9fa1-7e0c6ab9dbc0 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:21.508391 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-9965370f-5251-4486-9fa1-7e0c6ab9dbc0 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:21.543420 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-9965370f-5251-4486-9fa1-7e0c6ab9dbc0 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/4ec3db0e-4592-4839-b939-de6f7b4ad37c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044406 Aug 03 05:25:21.543420 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 519/1071] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Aug 3 05:25:21 2022] GET /compute/v2.1/servers/4ec3db0e-4592-4839-b939-de6f7b4ad37c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:25:22.551015 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-b3d6bc20-4267-461e-9cb1-95714e5188c9 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:25:22.553730 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-b3d6bc20-4267-461e-9cb1-95714e5188c9 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 4ec3db0e-4592-4839-b939-de6f7b4ad37c] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:25:22.560485 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b3d6bc20-4267-461e-9cb1-95714e5188c9 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:22.560936 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b3d6bc20-4267-461e-9cb1-95714e5188c9 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:22.561734 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b3d6bc20-4267-461e-9cb1-95714e5188c9 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:22.562172 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b3d6bc20-4267-461e-9cb1-95714e5188c9 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:22.591222 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-b3d6bc20-4267-461e-9cb1-95714e5188c9 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/4ec3db0e-4592-4839-b939-de6f7b4ad37c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044285 Aug 03 05:25:22.591776 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 553/1072] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Aug 3 05:25:22 2022] GET /compute/v2.1/servers/4ec3db0e-4592-4839-b939-de6f7b4ad37c/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 05:25:22.656033 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-c08fb12b-ab64-45be-8023-055af5e69f46 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:25:22.656542 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-c08fb12b-ab64-45be-8023-055af5e69f46 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 4ec3db0e-4592-4839-b939-de6f7b4ad37c] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:25:22.663913 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-c08fb12b-ab64-45be-8023-055af5e69f46 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:22.664369 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-c08fb12b-ab64-45be-8023-055af5e69f46 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:22.665332 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-c08fb12b-ab64-45be-8023-055af5e69f46 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:22.665778 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-c08fb12b-ab64-45be-8023-055af5e69f46 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:22.692991 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-c08fb12b-ab64-45be-8023-055af5e69f46 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 4ec3db0e-4592-4839-b939-de6f7b4ad37c] Going to try to terminate instance {{(pid=118332) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:25:23.028517 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-c08fb12b-ab64-45be-8023-055af5e69f46 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4ec3db0e-4592-4839-b939-de6f7b4ad37c" status: 204 len: 0 microversion: 2.1 time: 0.376042 Aug 03 05:25:23.029121 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 520/1073] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Aug 3 05:25:22 2022] DELETE /compute/v2.1/servers/4ec3db0e-4592-4839-b939-de6f7b4ad37c => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:25:23.037264 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-a6c503d6-8531-484b-9b19-eb28eb015015 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:25:23.038538 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-a6c503d6-8531-484b-9b19-eb28eb015015 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 4ec3db0e-4592-4839-b939-de6f7b4ad37c] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:25:23.044615 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a6c503d6-8531-484b-9b19-eb28eb015015 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:23.045072 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a6c503d6-8531-484b-9b19-eb28eb015015 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:23.045847 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a6c503d6-8531-484b-9b19-eb28eb015015 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:23.046295 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a6c503d6-8531-484b-9b19-eb28eb015015 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:23.180014 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-a6c503d6-8531-484b-9b19-eb28eb015015 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729a6d00e1664a6298088e52de9999f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041a553912c64de981d9f87b551c190f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:25:23.187466 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-a6c503d6-8531-484b-9b19-eb28eb015015 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/4ec3db0e-4592-4839-b939-de6f7b4ad37c" status: 200 len: 1681 microversion: 2.1 time: 0.154140 Aug 03 05:25:23.188035 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 554/1074] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:25:23 2022] GET /compute/v2.1/servers/4ec3db0e-4592-4839-b939-de6f7b4ad37c => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:25:24.209692 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-5358f75c-e74c-4ea3-8a68-104895cc6cb8 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:25:24.210425 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-5358f75c-e74c-4ea3-8a68-104895cc6cb8 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 4ec3db0e-4592-4839-b939-de6f7b4ad37c] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:25:24.216978 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-5358f75c-e74c-4ea3-8a68-104895cc6cb8 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:24.217429 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-5358f75c-e74c-4ea3-8a68-104895cc6cb8 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:24.218197 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-5358f75c-e74c-4ea3-8a68-104895cc6cb8 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:24.218643 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-5358f75c-e74c-4ea3-8a68-104895cc6cb8 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:24.347304 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-5358f75c-e74c-4ea3-8a68-104895cc6cb8 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729a6d00e1664a6298088e52de9999f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041a553912c64de981d9f87b551c190f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:25:24.355261 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-5358f75c-e74c-4ea3-8a68-104895cc6cb8 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/4ec3db0e-4592-4839-b939-de6f7b4ad37c" status: 200 len: 1681 microversion: 2.1 time: 0.149807 Aug 03 05:25:24.355825 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 521/1075] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:25:24 2022] GET /compute/v2.1/servers/4ec3db0e-4592-4839-b939-de6f7b4ad37c => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:25:25.379538 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-ddf117d5-5ea2-4e3b-a84f-aac9d9688234 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:25:25.379928 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-ddf117d5-5ea2-4e3b-a84f-aac9d9688234 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 4ec3db0e-4592-4839-b939-de6f7b4ad37c] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:25:25.387279 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ddf117d5-5ea2-4e3b-a84f-aac9d9688234 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:25.387739 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ddf117d5-5ea2-4e3b-a84f-aac9d9688234 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:25.388521 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ddf117d5-5ea2-4e3b-a84f-aac9d9688234 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:25.388966 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ddf117d5-5ea2-4e3b-a84f-aac9d9688234 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:25.481896 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-ddf117d5-5ea2-4e3b-a84f-aac9d9688234 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729a6d00e1664a6298088e52de9999f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041a553912c64de981d9f87b551c190f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:25:25.489919 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-ddf117d5-5ea2-4e3b-a84f-aac9d9688234 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/4ec3db0e-4592-4839-b939-de6f7b4ad37c" status: 200 len: 1613 microversion: 2.1 time: 0.116966 Aug 03 05:25:25.490507 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 555/1076] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:25:25 2022] GET /compute/v2.1/servers/4ec3db0e-4592-4839-b939-de6f7b4ad37c => generated 1613 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:25:25.677986 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [req-e2530c8b-c80e-41a9-a7b7-62573e05f8b9 req-6a17c0c4-f9ca-4f7e-994a-73a1befda73a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ec3db0e-4592-4839-b939-de6f7b4ad37c", "name": "network-vif-deleted", "tag": "89990246-38c7-461e-972a-0827c62a30f6"}]} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:25:25.688753 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-e2530c8b-c80e-41a9-a7b7-62573e05f8b9 req-6a17c0c4-f9ca-4f7e-994a-73a1befda73a service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:25.689284 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-e2530c8b-c80e-41a9-a7b7-62573e05f8b9 req-6a17c0c4-f9ca-4f7e-994a-73a1befda73a service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:25.702178 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.compute.server_external_events [req-e2530c8b-c80e-41a9-a7b7-62573e05f8b9 req-6a17c0c4-f9ca-4f7e-994a-73a1befda73a service nova] Creating event network-vif-deleted:89990246-38c7-461e-972a-0827c62a30f6 for instance 4ec3db0e-4592-4839-b939-de6f7b4ad37c on hv-cinder-85127 Aug 03 05:25:25.707503 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [req-e2530c8b-c80e-41a9-a7b7-62573e05f8b9 req-6a17c0c4-f9ca-4f7e-994a-73a1befda73a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039583 Aug 03 05:25:25.708229 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 522/1077] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:25:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:25:25.977102 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-d39d275a-03e4-4be9-8971-81af76c39868 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-129301463", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1057909603", "security_groups": [{"name": "tempest-secgroup-smoke-1007032199"}], "block_device_mapping_v2": [{"uuid": "ec9b24b1-3a3d-4c56-a468-aea39e8c190b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d274ff51-9652-4d23-8cbb-d03e5409ca96"}]}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:25:26.102381 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.network.neutron [None req-d39d275a-03e4-4be9-8971-81af76c39868 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] validate_networks() for [('d274ff51-9652-4d23-8cbb-d03e5409ca96', None, None, None, None, None)] {{(pid=118331) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:25:26.514236 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-251165e8-fd8a-4d82-896a-2c9516fb4069 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:25:26.515501 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-251165e8-fd8a-4d82-896a-2c9516fb4069 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 4ec3db0e-4592-4839-b939-de6f7b4ad37c] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:25:26.528054 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-251165e8-fd8a-4d82-896a-2c9516fb4069 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:26.529413 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-251165e8-fd8a-4d82-896a-2c9516fb4069 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:26.530377 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-251165e8-fd8a-4d82-896a-2c9516fb4069 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:26.530994 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-251165e8-fd8a-4d82-896a-2c9516fb4069 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:26.545788 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-d39d275a-03e4-4be9-8971-81af76c39868 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Flavor limits 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:25:26.546781 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-d39d275a-03e4-4be9-8971-81af76c39868 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Image limits 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:25:26.547473 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-d39d275a-03e4-4be9-8971-81af76c39868 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Flavor pref 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:25:26.548068 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-d39d275a-03e4-4be9-8971-81af76c39868 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Image pref 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:25:26.548664 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-d39d275a-03e4-4be9-8971-81af76c39868 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:25:26.558312 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d39d275a-03e4-4be9-8971-81af76c39868 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:26.558785 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d39d275a-03e4-4be9-8971-81af76c39868 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:26.559629 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d39d275a-03e4-4be9-8971-81af76c39868 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:26.560074 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d39d275a-03e4-4be9-8971-81af76c39868 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:26.585686 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-d39d275a-03e4-4be9-8971-81af76c39868 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Getting quotas for project 3c986ef0f5ea46f9b5e788aaca042b06. Resources: {'instances', 'ram', 'cores'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:25:26.587190 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-251165e8-fd8a-4d82-896a-2c9516fb4069 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:26.587656 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-251165e8-fd8a-4d82-896a-2c9516fb4069 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:26.588111 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.objects.instance [None req-251165e8-fd8a-4d82-896a-2c9516fb4069 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lazy-loading 'fault' on Instance uuid 4ec3db0e-4592-4839-b939-de6f7b4ad37c {{(pid=118332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:25:26.589991 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-d39d275a-03e4-4be9-8971-81af76c39868 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Getting quotas for user ac3954ab39014ef3819111a6fe8142b7 and project 3c986ef0f5ea46f9b5e788aaca042b06. Resources: {'instances', 'ram', 'cores'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:25:26.635870 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-251165e8-fd8a-4d82-896a-2c9516fb4069 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729a6d00e1664a6298088e52de9999f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041a553912c64de981d9f87b551c190f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:25:26.643521 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-251165e8-fd8a-4d82-896a-2c9516fb4069 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/4ec3db0e-4592-4839-b939-de6f7b4ad37c" status: 200 len: 1331 microversion: 2.1 time: 0.133559 Aug 03 05:25:26.644412 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 523/1078] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:25:26 2022] GET /compute/v2.1/servers/4ec3db0e-4592-4839-b939-de6f7b4ad37c => generated 1331 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:25:26.660905 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-d39d275a-03e4-4be9-8971-81af76c39868 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Going to run 1 instances... {{(pid=118331) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:25:26.669649 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-d39d275a-03e4-4be9-8971-81af76c39868 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: adbab481-7f3a-4430-be8a-4429a6e46b4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ec9b24b1-3a3d-4c56-a468-aea39e8c190b',volume_size=None,volume_type=None)] {{(pid=118331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:25:27.029198 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-d39d275a-03e4-4be9-8971-81af76c39868 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.057319 Aug 03 05:25:27.030032 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 556/1079] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Aug 3 05:25:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 1059 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 05:25:27.042516 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-5b716d0f-d9c7-4685-9b98-21b32358fd08 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:25:27.043164 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-5b716d0f-d9c7-4685-9b98-21b32358fd08 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: adbab481-7f3a-4430-be8a-4429a6e46b4f] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:25:27.101421 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-5b716d0f-d9c7-4685-9b98-21b32358fd08 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3954ab39014ef3819111a6fe8142b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c986ef0f5ea46f9b5e788aaca042b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:25:27.107996 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-5b716d0f-d9c7-4685-9b98-21b32358fd08 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/adbab481-7f3a-4430-be8a-4429a6e46b4f" status: 200 len: 1094 microversion: 2.1 time: 0.070265 Aug 03 05:25:27.108563 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 524/1080] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:25:27 2022] GET /compute/v2.1/servers/adbab481-7f3a-4430-be8a-4429a6e46b4f => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:25:27.666216 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-c85cd3d1-e134-4ede-b518-5ad99ae40853 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:25:27.666927 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-c85cd3d1-e134-4ede-b518-5ad99ae40853 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 4ec3db0e-4592-4839-b939-de6f7b4ad37c] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:25:27.673889 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c85cd3d1-e134-4ede-b518-5ad99ae40853 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:27.674355 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c85cd3d1-e134-4ede-b518-5ad99ae40853 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:27.676371 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c85cd3d1-e134-4ede-b518-5ad99ae40853 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:27.676371 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c85cd3d1-e134-4ede-b518-5ad99ae40853 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:27.689620 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.wsgi [None req-c85cd3d1-e134-4ede-b518-5ad99ae40853 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] HTTP exception thrown: Instance 4ec3db0e-4592-4839-b939-de6f7b4ad37c could not be found. Aug 03 05:25:27.691643 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-c85cd3d1-e134-4ede-b518-5ad99ae40853 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Request method failure captured: Aug 03 05:25:27.691643 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: request: GET /compute/v2.1/servers/4ec3db0e-4592-4839-b939-de6f7b4ad37c HTTP/1.1 Aug 03 05:25:27.691643 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Accept: application/json Aug 03 05:25:27.691643 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Accept-Encoding: identity Aug 03 05:25:27.691643 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Connection: close Aug 03 05:25:27.691643 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Content-Length: 0 Aug 03 05:25:27.691643 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Content-Type: application/json Aug 03 05:25:27.691643 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Host: 10.222.0.40 Aug 03 05:25:27.691643 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Openstack-System-Scope: None Aug 03 05:25:27.691643 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: User-Agent: python-urllib3/1.26.10 Aug 03 05:25:27.691643 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Auth-Token: gAAAAABi6gW1r7_81Momgb9V-Pc_vaYPdWIEuBDrgd0bdt0JL5T9I4c2oaDN-tUUEDsquQZmmEtcUgaXB4e8p9ZfKilfQ3apGdtd4ucRlv8R2i8xepw63Jaug8YDHRv4HToMeBhksVOaOx18akgjOb1gnyi4ud6p4nKX_aDqks7lJc8JWWzNrtc Aug 03 05:25:27.691643 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Domain-Id: None Aug 03 05:25:27.691643 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Domain-Name: None Aug 03 05:25:27.691643 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Identity-Status: Confirmed Aug 03 05:25:27.691643 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Is-Admin-Project: True Aug 03 05:25:27.691643 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Domain-Id: default Aug 03 05:25:27.691643 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Domain-Name: Default Aug 03 05:25:27.691643 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Id: 041a553912c64de981d9f87b551c190f Aug 03 05:25:27.691643 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Name: tempest-AttachVolumeNegativeTest-1549219107 Aug 03 05:25:27.691643 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Role: member,reader Aug 03 05:25:27.691643 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Roles: member,reader Aug 03 05:25:27.693544 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_041a553912c64de981d9f87b551c190f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/041a553912c64de981d9f87b551c190f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/041a553912c64de981d9f87b551c190f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/041a553912c64de981d9f87b551c190f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:25:27.693544 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant: tempest-AttachVolumeNegativeTest-1549219107 Aug 03 05:25:27.693544 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant-Id: 041a553912c64de981d9f87b551c190f Aug 03 05:25:27.693544 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1549219107 Aug 03 05:25:27.693544 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User: tempest-AttachVolumeNegativeTest-1549219107-project Aug 03 05:25:27.693544 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Domain-Id: default Aug 03 05:25:27.693544 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Domain-Name: Default Aug 03 05:25:27.693544 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Id: 729a6d00e1664a6298088e52de9999f5 Aug 03 05:25:27.693544 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Name: tempest-AttachVolumeNegativeTest-1549219107-project Aug 03 05:25:27.693544 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: method: > Aug 03 05:25:27.693544 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: exception: Instance 4ec3db0e-4592-4839-b939-de6f7b4ad37c could not be found. Aug 03 05:25:27.693544 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: action_args: {'id': '4ec3db0e-4592-4839-b939-de6f7b4ad37c'} Aug 03 05:25:27.695482 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:25:27.695482 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:25:27.695482 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:25:27.695482 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:25:27.695482 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:25:27.695482 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:25:27.695482 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:25:27.695482 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:25:27.695482 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:25:27.695482 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:25:27.695482 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ec3db0e-4592-4839-b939-de6f7b4ad37c could not be found. Aug 03 05:25:27.695482 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:25:27.695482 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:25:27.695482 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:25:27.695482 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:25:27.695482 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:25:27.695482 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:25:27.695482 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:25:27.695482 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:25:27.695482 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:25:27.697115 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:25:27.697115 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:25:27.697115 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:25:27.697115 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:25:27.697115 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:25:27.697115 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:25:27.697115 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:25:27.697115 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ec3db0e-4592-4839-b939-de6f7b4ad37c could not be found. Aug 03 05:25:27.697115 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:25:27.697115 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:25:27.697115 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:25:27.697115 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:25:27.697115 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:25:27.697115 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:25:27.697115 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:25:27.697115 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:25:27.697115 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ec3db0e-4592-4839-b939-de6f7b4ad37c could not be found. Aug 03 05:25:27.697115 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:25:27.698941 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-c85cd3d1-e134-4ede-b518-5ad99ae40853 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Returning 404 to user: Instance 4ec3db0e-4592-4839-b939-de6f7b4ad37c could not be found. {{(pid=118331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:25:27.698941 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-c85cd3d1-e134-4ede-b518-5ad99ae40853 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/4ec3db0e-4592-4839-b939-de6f7b4ad37c" status: 404 len: 111 microversion: 2.1 time: 0.031297 Aug 03 05:25:27.698941 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 557/1081] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:25:27 2022] GET /compute/v2.1/servers/4ec3db0e-4592-4839-b939-de6f7b4ad37c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:25:27.704249 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-6cd1e56a-2b47-4f36-a8b9-f8e7ffa842bb tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '.version_select at 0x7f7601da3280>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:25:27.812483 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-6cd1e56a-2b47-4f36-a8b9-f8e7ffa842bb tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1545770912" status: 202 len: 0 microversion: 2.1 time: 0.111990 Aug 03 05:25:27.813073 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 525/1082] 10.222.0.40 () {58 vars in 1221 bytes} [Wed Aug 3 05:25:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1545770912 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:25:28.127772 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-578518d3-839c-4377-8608-323a923e147e tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:25:28.128384 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-578518d3-839c-4377-8608-323a923e147e tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: adbab481-7f3a-4430-be8a-4429a6e46b4f] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:25:28.134587 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-578518d3-839c-4377-8608-323a923e147e tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:28.135085 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-578518d3-839c-4377-8608-323a923e147e tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:28.135861 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-578518d3-839c-4377-8608-323a923e147e tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:28.136303 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-578518d3-839c-4377-8608-323a923e147e tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:28.216169 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-578518d3-839c-4377-8608-323a923e147e tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3954ab39014ef3819111a6fe8142b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c986ef0f5ea46f9b5e788aaca042b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:25:28.223645 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-578518d3-839c-4377-8608-323a923e147e tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/adbab481-7f3a-4430-be8a-4429a6e46b4f" status: 200 len: 1144 microversion: 2.1 time: 0.099695 Aug 03 05:25:28.224338 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 558/1083] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:25:28 2022] GET /compute/v2.1/servers/adbab481-7f3a-4430-be8a-4429a6e46b4f => generated 1144 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:25:29.246052 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-7a1b6480-bd85-4b76-86ed-3f8f2f374bab tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:25:29.246644 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-7a1b6480-bd85-4b76-86ed-3f8f2f374bab tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: adbab481-7f3a-4430-be8a-4429a6e46b4f] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:25:29.253012 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-7a1b6480-bd85-4b76-86ed-3f8f2f374bab tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:29.253469 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-7a1b6480-bd85-4b76-86ed-3f8f2f374bab tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:29.254308 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-7a1b6480-bd85-4b76-86ed-3f8f2f374bab tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:29.254753 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-7a1b6480-bd85-4b76-86ed-3f8f2f374bab tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:29.356165 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-7a1b6480-bd85-4b76-86ed-3f8f2f374bab tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3954ab39014ef3819111a6fe8142b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c986ef0f5ea46f9b5e788aaca042b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:25:29.364571 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-7a1b6480-bd85-4b76-86ed-3f8f2f374bab tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/adbab481-7f3a-4430-be8a-4429a6e46b4f" status: 200 len: 1200 microversion: 2.1 time: 0.123047 Aug 03 05:25:29.365316 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 526/1084] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:25:29 2022] GET /compute/v2.1/servers/adbab481-7f3a-4430-be8a-4429a6e46b4f => generated 1200 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:25:29.975892 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-473f4c58-bb3e-4278-9dfc-590d25d221c4 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:25:29.976484 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-473f4c58-bb3e-4278-9dfc-590d25d221c4 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 4ec3db0e-4592-4839-b939-de6f7b4ad37c] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:25:29.983079 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-473f4c58-bb3e-4278-9dfc-590d25d221c4 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:29.983532 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-473f4c58-bb3e-4278-9dfc-590d25d221c4 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:29.984314 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-473f4c58-bb3e-4278-9dfc-590d25d221c4 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:29.984756 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-473f4c58-bb3e-4278-9dfc-590d25d221c4 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:29.998705 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.wsgi [None req-473f4c58-bb3e-4278-9dfc-590d25d221c4 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] HTTP exception thrown: Instance 4ec3db0e-4592-4839-b939-de6f7b4ad37c could not be found. Aug 03 05:25:30.000302 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-473f4c58-bb3e-4278-9dfc-590d25d221c4 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Request method failure captured: Aug 03 05:25:30.000302 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: request: DELETE /compute/v2.1/servers/4ec3db0e-4592-4839-b939-de6f7b4ad37c HTTP/1.1 Aug 03 05:25:30.000302 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Accept: application/json Aug 03 05:25:30.000302 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Accept-Encoding: identity Aug 03 05:25:30.000302 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Connection: close Aug 03 05:25:30.000302 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Content-Length: 0 Aug 03 05:25:30.000302 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Content-Type: application/json Aug 03 05:25:30.000302 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Host: 10.222.0.40 Aug 03 05:25:30.000302 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Openstack-System-Scope: None Aug 03 05:25:30.000302 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: User-Agent: python-urllib3/1.26.10 Aug 03 05:25:30.000302 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Auth-Token: gAAAAABi6gW1r7_81Momgb9V-Pc_vaYPdWIEuBDrgd0bdt0JL5T9I4c2oaDN-tUUEDsquQZmmEtcUgaXB4e8p9ZfKilfQ3apGdtd4ucRlv8R2i8xepw63Jaug8YDHRv4HToMeBhksVOaOx18akgjOb1gnyi4ud6p4nKX_aDqks7lJc8JWWzNrtc Aug 03 05:25:30.000302 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Domain-Id: None Aug 03 05:25:30.000302 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Domain-Name: None Aug 03 05:25:30.000302 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Identity-Status: Confirmed Aug 03 05:25:30.000302 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Is-Admin-Project: True Aug 03 05:25:30.000302 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Domain-Id: default Aug 03 05:25:30.000302 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Domain-Name: Default Aug 03 05:25:30.000302 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Id: 041a553912c64de981d9f87b551c190f Aug 03 05:25:30.000302 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Name: tempest-AttachVolumeNegativeTest-1549219107 Aug 03 05:25:30.000302 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Role: member,reader Aug 03 05:25:30.000302 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Roles: member,reader Aug 03 05:25:30.002145 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_041a553912c64de981d9f87b551c190f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/041a553912c64de981d9f87b551c190f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/041a553912c64de981d9f87b551c190f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/041a553912c64de981d9f87b551c190f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:25:30.002145 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant: tempest-AttachVolumeNegativeTest-1549219107 Aug 03 05:25:30.002145 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant-Id: 041a553912c64de981d9f87b551c190f Aug 03 05:25:30.002145 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1549219107 Aug 03 05:25:30.002145 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User: tempest-AttachVolumeNegativeTest-1549219107-project Aug 03 05:25:30.002145 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Domain-Id: default Aug 03 05:25:30.002145 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Domain-Name: Default Aug 03 05:25:30.002145 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Id: 729a6d00e1664a6298088e52de9999f5 Aug 03 05:25:30.002145 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Name: tempest-AttachVolumeNegativeTest-1549219107-project Aug 03 05:25:30.002145 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: method: > Aug 03 05:25:30.002145 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: exception: Instance 4ec3db0e-4592-4839-b939-de6f7b4ad37c could not be found. Aug 03 05:25:30.002145 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: action_args: {'id': '4ec3db0e-4592-4839-b939-de6f7b4ad37c'} Aug 03 05:25:30.003139 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:25:30.003139 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:25:30.003139 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:25:30.003139 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:25:30.003139 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:25:30.003139 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:25:30.003139 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:25:30.003139 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:25:30.003139 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:25:30.003139 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:25:30.003139 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ec3db0e-4592-4839-b939-de6f7b4ad37c could not be found. Aug 03 05:25:30.003139 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:25:30.003139 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:25:30.003139 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:25:30.003139 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:25:30.003139 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:25:30.003139 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:25:30.003139 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:25:30.003139 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:25:30.003139 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:25:30.004429 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:25:30.004429 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 05:25:30.004429 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 05:25:30.004429 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 05:25:30.004429 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 05:25:30.004429 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:25:30.004429 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:25:30.004429 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:25:30.004429 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:25:30.004429 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ec3db0e-4592-4839-b939-de6f7b4ad37c could not be found. Aug 03 05:25:30.004429 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:25:30.004429 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:25:30.004429 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:25:30.004429 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:25:30.004429 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:25:30.004429 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:25:30.004429 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:25:30.004429 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:25:30.004429 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ec3db0e-4592-4839-b939-de6f7b4ad37c could not be found. Aug 03 05:25:30.004429 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:25:30.005745 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-473f4c58-bb3e-4278-9dfc-590d25d221c4 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Returning 404 to user: Instance 4ec3db0e-4592-4839-b939-de6f7b4ad37c could not be found. {{(pid=118331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:25:30.005745 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-473f4c58-bb3e-4278-9dfc-590d25d221c4 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4ec3db0e-4592-4839-b939-de6f7b4ad37c" status: 404 len: 111 microversion: 2.1 time: 0.030031 Aug 03 05:25:30.005745 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 559/1085] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Aug 3 05:25:29 2022] DELETE /compute/v2.1/servers/4ec3db0e-4592-4839-b939-de6f7b4ad37c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:25:30.011490 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-9419bc01-4a37-4aad-abb1-857432da0a1b tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:25:30.012114 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-9419bc01-4a37-4aad-abb1-857432da0a1b tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 4ec3db0e-4592-4839-b939-de6f7b4ad37c] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:25:30.019276 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-9419bc01-4a37-4aad-abb1-857432da0a1b tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:30.019677 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-9419bc01-4a37-4aad-abb1-857432da0a1b tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:30.020230 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-9419bc01-4a37-4aad-abb1-857432da0a1b tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:30.020668 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-9419bc01-4a37-4aad-abb1-857432da0a1b tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:30.035195 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.wsgi [None req-9419bc01-4a37-4aad-abb1-857432da0a1b tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] HTTP exception thrown: Instance 4ec3db0e-4592-4839-b939-de6f7b4ad37c could not be found. Aug 03 05:25:30.037635 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-9419bc01-4a37-4aad-abb1-857432da0a1b tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Request method failure captured: Aug 03 05:25:30.037635 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: request: GET /compute/v2.1/servers/4ec3db0e-4592-4839-b939-de6f7b4ad37c HTTP/1.1 Aug 03 05:25:30.037635 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Accept: application/json Aug 03 05:25:30.037635 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Accept-Encoding: identity Aug 03 05:25:30.037635 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Connection: close Aug 03 05:25:30.037635 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Content-Length: 0 Aug 03 05:25:30.037635 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Content-Type: application/json Aug 03 05:25:30.037635 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Host: 10.222.0.40 Aug 03 05:25:30.037635 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Openstack-System-Scope: None Aug 03 05:25:30.037635 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: User-Agent: python-urllib3/1.26.10 Aug 03 05:25:30.037635 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Auth-Token: gAAAAABi6gW1r7_81Momgb9V-Pc_vaYPdWIEuBDrgd0bdt0JL5T9I4c2oaDN-tUUEDsquQZmmEtcUgaXB4e8p9ZfKilfQ3apGdtd4ucRlv8R2i8xepw63Jaug8YDHRv4HToMeBhksVOaOx18akgjOb1gnyi4ud6p4nKX_aDqks7lJc8JWWzNrtc Aug 03 05:25:30.037635 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Domain-Id: None Aug 03 05:25:30.037635 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Domain-Name: None Aug 03 05:25:30.037635 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Identity-Status: Confirmed Aug 03 05:25:30.037635 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Is-Admin-Project: True Aug 03 05:25:30.037635 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Domain-Id: default Aug 03 05:25:30.037635 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Domain-Name: Default Aug 03 05:25:30.037635 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Id: 041a553912c64de981d9f87b551c190f Aug 03 05:25:30.037635 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Name: tempest-AttachVolumeNegativeTest-1549219107 Aug 03 05:25:30.037635 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Role: member,reader Aug 03 05:25:30.037635 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Roles: member,reader Aug 03 05:25:30.043169 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_041a553912c64de981d9f87b551c190f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/041a553912c64de981d9f87b551c190f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/041a553912c64de981d9f87b551c190f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/041a553912c64de981d9f87b551c190f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:25:30.043169 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant: tempest-AttachVolumeNegativeTest-1549219107 Aug 03 05:25:30.043169 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant-Id: 041a553912c64de981d9f87b551c190f Aug 03 05:25:30.043169 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1549219107 Aug 03 05:25:30.043169 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User: tempest-AttachVolumeNegativeTest-1549219107-project Aug 03 05:25:30.043169 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Domain-Id: default Aug 03 05:25:30.043169 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Domain-Name: Default Aug 03 05:25:30.043169 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Id: 729a6d00e1664a6298088e52de9999f5 Aug 03 05:25:30.043169 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Name: tempest-AttachVolumeNegativeTest-1549219107-project Aug 03 05:25:30.043169 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: method: > Aug 03 05:25:30.043169 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: exception: Instance 4ec3db0e-4592-4839-b939-de6f7b4ad37c could not be found. Aug 03 05:25:30.043169 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: action_args: {'id': '4ec3db0e-4592-4839-b939-de6f7b4ad37c'} Aug 03 05:25:30.044129 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:25:30.044129 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:25:30.044129 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:25:30.044129 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:25:30.044129 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:25:30.044129 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:25:30.044129 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:25:30.044129 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:25:30.044129 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:25:30.044129 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:25:30.044129 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ec3db0e-4592-4839-b939-de6f7b4ad37c could not be found. Aug 03 05:25:30.044129 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:30.044129 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:25:30.044129 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:30.044129 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:25:30.044129 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:25:30.044129 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:25:30.044129 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:25:30.044129 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:25:30.044129 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:25:30.045668 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:25:30.045668 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:25:30.045668 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:25:30.045668 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:25:30.045668 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:25:30.045668 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:25:30.045668 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:25:30.045668 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ec3db0e-4592-4839-b939-de6f7b4ad37c could not be found. Aug 03 05:25:30.045668 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:30.045668 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:25:30.045668 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:30.045668 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:25:30.045668 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:25:30.045668 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:25:30.045668 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:25:30.045668 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:25:30.045668 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ec3db0e-4592-4839-b939-de6f7b4ad37c could not be found. Aug 03 05:25:30.045668 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:30.047050 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-9419bc01-4a37-4aad-abb1-857432da0a1b tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Returning 404 to user: Instance 4ec3db0e-4592-4839-b939-de6f7b4ad37c could not be found. {{(pid=118332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:25:30.047050 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-9419bc01-4a37-4aad-abb1-857432da0a1b tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/4ec3db0e-4592-4839-b939-de6f7b4ad37c" status: 404 len: 111 microversion: 2.1 time: 0.031683 Aug 03 05:25:30.047050 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 527/1086] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:25:30 2022] GET /compute/v2.1/servers/4ec3db0e-4592-4839-b939-de6f7b4ad37c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:25:30.390099 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-8b88d0f9-252c-4dc3-9ac7-6bd256ced997 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:25:30.390822 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-8b88d0f9-252c-4dc3-9ac7-6bd256ced997 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: adbab481-7f3a-4430-be8a-4429a6e46b4f] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:25:30.397405 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8b88d0f9-252c-4dc3-9ac7-6bd256ced997 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:30.399687 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8b88d0f9-252c-4dc3-9ac7-6bd256ced997 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:30.399687 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8b88d0f9-252c-4dc3-9ac7-6bd256ced997 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:30.399687 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8b88d0f9-252c-4dc3-9ac7-6bd256ced997 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:30.644263 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-8b88d0f9-252c-4dc3-9ac7-6bd256ced997 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3954ab39014ef3819111a6fe8142b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c986ef0f5ea46f9b5e788aaca042b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:25:30.653496 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-8b88d0f9-252c-4dc3-9ac7-6bd256ced997 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/adbab481-7f3a-4430-be8a-4429a6e46b4f" status: 200 len: 1278 microversion: 2.1 time: 0.267270 Aug 03 05:25:30.654073 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 560/1087] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:25:30 2022] GET /compute/v2.1/servers/adbab481-7f3a-4430-be8a-4429a6e46b4f => generated 1278 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:25:31.186044 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [req-b05a56a7-06a9-475f-964c-a1c8724cde7d req-b8aa10c9-fe35-4db9-b4dd-509b1dd9498e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adbab481-7f3a-4430-be8a-4429a6e46b4f", "tag": "747aa0a4-d518-4bbd-9bd6-84fef957148e"}]} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:25:31.197581 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-b05a56a7-06a9-475f-964c-a1c8724cde7d req-b8aa10c9-fe35-4db9-b4dd-509b1dd9498e service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:31.198030 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-b05a56a7-06a9-475f-964c-a1c8724cde7d req-b8aa10c9-fe35-4db9-b4dd-509b1dd9498e service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:31.210817 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.compute.server_external_events [req-b05a56a7-06a9-475f-964c-a1c8724cde7d req-b8aa10c9-fe35-4db9-b4dd-509b1dd9498e service nova] Creating event network-changed:747aa0a4-d518-4bbd-9bd6-84fef957148e for instance adbab481-7f3a-4430-be8a-4429a6e46b4f on hv-cinder-85127 Aug 03 05:25:31.218692 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [req-b05a56a7-06a9-475f-964c-a1c8724cde7d req-b8aa10c9-fe35-4db9-b4dd-509b1dd9498e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035361 Aug 03 05:25:31.218692 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 528/1088] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:25:31.341368 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-5acfebc9-cc03-4682-a65f-5fdd6113f812 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:25:31.341957 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-5acfebc9-cc03-4682-a65f-5fdd6113f812 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: d6b60ff4-a76f-4b50-8e1b-2b11561286b2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:25:31.348929 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5acfebc9-cc03-4682-a65f-5fdd6113f812 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:31.349472 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5acfebc9-cc03-4682-a65f-5fdd6113f812 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:31.350924 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5acfebc9-cc03-4682-a65f-5fdd6113f812 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:31.351573 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5acfebc9-cc03-4682-a65f-5fdd6113f812 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:31.364948 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.wsgi [None req-5acfebc9-cc03-4682-a65f-5fdd6113f812 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] HTTP exception thrown: Instance d6b60ff4-a76f-4b50-8e1b-2b11561286b2 could not be found. Aug 03 05:25:31.366526 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-5acfebc9-cc03-4682-a65f-5fdd6113f812 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Request method failure captured: Aug 03 05:25:31.366526 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: request: DELETE /compute/v2.1/servers/d6b60ff4-a76f-4b50-8e1b-2b11561286b2 HTTP/1.1 Aug 03 05:25:31.366526 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Accept: application/json Aug 03 05:25:31.366526 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Accept-Encoding: identity Aug 03 05:25:31.366526 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Connection: close Aug 03 05:25:31.366526 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Content-Length: 0 Aug 03 05:25:31.366526 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Content-Type: application/json Aug 03 05:25:31.366526 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Host: 10.222.0.40 Aug 03 05:25:31.366526 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Openstack-System-Scope: None Aug 03 05:25:31.366526 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: User-Agent: python-urllib3/1.26.10 Aug 03 05:25:31.366526 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Auth-Token: gAAAAABi6gW1r7_81Momgb9V-Pc_vaYPdWIEuBDrgd0bdt0JL5T9I4c2oaDN-tUUEDsquQZmmEtcUgaXB4e8p9ZfKilfQ3apGdtd4ucRlv8R2i8xepw63Jaug8YDHRv4HToMeBhksVOaOx18akgjOb1gnyi4ud6p4nKX_aDqks7lJc8JWWzNrtc Aug 03 05:25:31.366526 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Domain-Id: None Aug 03 05:25:31.366526 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Domain-Name: None Aug 03 05:25:31.366526 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Identity-Status: Confirmed Aug 03 05:25:31.366526 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Is-Admin-Project: True Aug 03 05:25:31.366526 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Domain-Id: default Aug 03 05:25:31.366526 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Domain-Name: Default Aug 03 05:25:31.366526 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Id: 041a553912c64de981d9f87b551c190f Aug 03 05:25:31.366526 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Name: tempest-AttachVolumeNegativeTest-1549219107 Aug 03 05:25:31.366526 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Role: member,reader Aug 03 05:25:31.366526 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Roles: member,reader Aug 03 05:25:31.368051 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_041a553912c64de981d9f87b551c190f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/041a553912c64de981d9f87b551c190f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/041a553912c64de981d9f87b551c190f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/041a553912c64de981d9f87b551c190f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:25:31.368051 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant: tempest-AttachVolumeNegativeTest-1549219107 Aug 03 05:25:31.368051 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant-Id: 041a553912c64de981d9f87b551c190f Aug 03 05:25:31.368051 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1549219107 Aug 03 05:25:31.368051 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User: tempest-AttachVolumeNegativeTest-1549219107-project Aug 03 05:25:31.368051 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Domain-Id: default Aug 03 05:25:31.368051 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Domain-Name: Default Aug 03 05:25:31.368051 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Id: 729a6d00e1664a6298088e52de9999f5 Aug 03 05:25:31.368051 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Name: tempest-AttachVolumeNegativeTest-1549219107-project Aug 03 05:25:31.368051 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: method: > Aug 03 05:25:31.368051 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: exception: Instance d6b60ff4-a76f-4b50-8e1b-2b11561286b2 could not be found. Aug 03 05:25:31.368051 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: action_args: {'id': 'd6b60ff4-a76f-4b50-8e1b-2b11561286b2'} Aug 03 05:25:31.368850 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:25:31.368850 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:25:31.368850 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:25:31.368850 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:25:31.368850 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:25:31.368850 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:25:31.368850 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:25:31.368850 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:25:31.368850 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:25:31.368850 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:25:31.368850 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6b60ff4-a76f-4b50-8e1b-2b11561286b2 could not be found. Aug 03 05:25:31.368850 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:25:31.368850 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:25:31.368850 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:25:31.368850 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:25:31.368850 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:25:31.368850 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:25:31.368850 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:25:31.368850 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:25:31.368850 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:25:31.370133 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:25:31.370133 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 05:25:31.370133 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 05:25:31.370133 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 05:25:31.370133 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 05:25:31.370133 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:25:31.370133 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:25:31.370133 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:25:31.370133 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:25:31.370133 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6b60ff4-a76f-4b50-8e1b-2b11561286b2 could not be found. Aug 03 05:25:31.370133 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:25:31.370133 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:25:31.370133 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:25:31.370133 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:25:31.370133 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:25:31.370133 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:25:31.370133 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:25:31.370133 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:25:31.370133 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6b60ff4-a76f-4b50-8e1b-2b11561286b2 could not be found. Aug 03 05:25:31.370133 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:25:31.372487 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-5acfebc9-cc03-4682-a65f-5fdd6113f812 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Returning 404 to user: Instance d6b60ff4-a76f-4b50-8e1b-2b11561286b2 could not be found. {{(pid=118331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:25:31.372487 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-5acfebc9-cc03-4682-a65f-5fdd6113f812 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d6b60ff4-a76f-4b50-8e1b-2b11561286b2" status: 404 len: 111 microversion: 2.1 time: 0.030510 Aug 03 05:25:31.372487 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 561/1089] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Aug 3 05:25:31 2022] DELETE /compute/v2.1/servers/d6b60ff4-a76f-4b50-8e1b-2b11561286b2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:25:31.377333 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-f7074dbd-1216-4378-93c3-84e399286197 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:25:31.378031 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-f7074dbd-1216-4378-93c3-84e399286197 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: d6b60ff4-a76f-4b50-8e1b-2b11561286b2] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:25:31.384227 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f7074dbd-1216-4378-93c3-84e399286197 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:31.384679 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f7074dbd-1216-4378-93c3-84e399286197 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:31.385437 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f7074dbd-1216-4378-93c3-84e399286197 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:31.385873 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-f7074dbd-1216-4378-93c3-84e399286197 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:31.399966 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.wsgi [None req-f7074dbd-1216-4378-93c3-84e399286197 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] HTTP exception thrown: Instance d6b60ff4-a76f-4b50-8e1b-2b11561286b2 could not be found. Aug 03 05:25:31.401635 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-f7074dbd-1216-4378-93c3-84e399286197 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Request method failure captured: Aug 03 05:25:31.401635 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: request: GET /compute/v2.1/servers/d6b60ff4-a76f-4b50-8e1b-2b11561286b2 HTTP/1.1 Aug 03 05:25:31.401635 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Accept: application/json Aug 03 05:25:31.401635 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Accept-Encoding: identity Aug 03 05:25:31.401635 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Connection: close Aug 03 05:25:31.401635 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Content-Length: 0 Aug 03 05:25:31.401635 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Content-Type: application/json Aug 03 05:25:31.401635 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Host: 10.222.0.40 Aug 03 05:25:31.401635 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Openstack-System-Scope: None Aug 03 05:25:31.401635 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: User-Agent: python-urllib3/1.26.10 Aug 03 05:25:31.401635 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Auth-Token: gAAAAABi6gW1r7_81Momgb9V-Pc_vaYPdWIEuBDrgd0bdt0JL5T9I4c2oaDN-tUUEDsquQZmmEtcUgaXB4e8p9ZfKilfQ3apGdtd4ucRlv8R2i8xepw63Jaug8YDHRv4HToMeBhksVOaOx18akgjOb1gnyi4ud6p4nKX_aDqks7lJc8JWWzNrtc Aug 03 05:25:31.401635 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Domain-Id: None Aug 03 05:25:31.401635 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Domain-Name: None Aug 03 05:25:31.401635 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Identity-Status: Confirmed Aug 03 05:25:31.401635 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Is-Admin-Project: True Aug 03 05:25:31.401635 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Domain-Id: default Aug 03 05:25:31.401635 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Domain-Name: Default Aug 03 05:25:31.401635 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Id: 041a553912c64de981d9f87b551c190f Aug 03 05:25:31.401635 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Name: tempest-AttachVolumeNegativeTest-1549219107 Aug 03 05:25:31.401635 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Role: member,reader Aug 03 05:25:31.401635 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Roles: member,reader Aug 03 05:25:31.403657 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_041a553912c64de981d9f87b551c190f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/041a553912c64de981d9f87b551c190f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/041a553912c64de981d9f87b551c190f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/041a553912c64de981d9f87b551c190f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:25:31.403657 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant: tempest-AttachVolumeNegativeTest-1549219107 Aug 03 05:25:31.403657 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant-Id: 041a553912c64de981d9f87b551c190f Aug 03 05:25:31.403657 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1549219107 Aug 03 05:25:31.403657 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User: tempest-AttachVolumeNegativeTest-1549219107-project Aug 03 05:25:31.403657 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Domain-Id: default Aug 03 05:25:31.403657 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Domain-Name: Default Aug 03 05:25:31.403657 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Id: 729a6d00e1664a6298088e52de9999f5 Aug 03 05:25:31.403657 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Name: tempest-AttachVolumeNegativeTest-1549219107-project Aug 03 05:25:31.403657 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: method: > Aug 03 05:25:31.403657 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: exception: Instance d6b60ff4-a76f-4b50-8e1b-2b11561286b2 could not be found. Aug 03 05:25:31.403657 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: action_args: {'id': 'd6b60ff4-a76f-4b50-8e1b-2b11561286b2'} Aug 03 05:25:31.404570 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:25:31.404570 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:25:31.404570 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:25:31.404570 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:25:31.404570 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:25:31.404570 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:25:31.404570 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:25:31.404570 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:25:31.404570 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:25:31.404570 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:25:31.404570 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6b60ff4-a76f-4b50-8e1b-2b11561286b2 could not be found. Aug 03 05:25:31.404570 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:31.404570 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:25:31.404570 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:31.404570 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:25:31.404570 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:25:31.404570 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:25:31.404570 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:25:31.404570 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:25:31.404570 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:25:31.406090 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:25:31.406090 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:25:31.406090 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:25:31.406090 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:25:31.406090 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:25:31.406090 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:25:31.406090 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:25:31.406090 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6b60ff4-a76f-4b50-8e1b-2b11561286b2 could not be found. Aug 03 05:25:31.406090 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:31.406090 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:25:31.406090 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:31.406090 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:25:31.406090 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:25:31.406090 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:25:31.406090 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:25:31.406090 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:25:31.406090 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6b60ff4-a76f-4b50-8e1b-2b11561286b2 could not be found. Aug 03 05:25:31.406090 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:31.407415 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-f7074dbd-1216-4378-93c3-84e399286197 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Returning 404 to user: Instance d6b60ff4-a76f-4b50-8e1b-2b11561286b2 could not be found. {{(pid=118332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:25:31.407415 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-f7074dbd-1216-4378-93c3-84e399286197 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/d6b60ff4-a76f-4b50-8e1b-2b11561286b2" status: 404 len: 111 microversion: 2.1 time: 0.030205 Aug 03 05:25:31.407415 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 529/1090] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:25:31 2022] GET /compute/v2.1/servers/d6b60ff4-a76f-4b50-8e1b-2b11561286b2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:25:31.413070 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-fb4eeb37-d3c1-4fad-bcfb-d4fdef35e0d6 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:25:31.413700 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-fb4eeb37-d3c1-4fad-bcfb-d4fdef35e0d6 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 9f32bcc7-80dd-457b-a908-9ae46c3d923d] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:25:31.419791 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fb4eeb37-d3c1-4fad-bcfb-d4fdef35e0d6 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:31.420245 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fb4eeb37-d3c1-4fad-bcfb-d4fdef35e0d6 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:31.421014 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fb4eeb37-d3c1-4fad-bcfb-d4fdef35e0d6 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:31.421456 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fb4eeb37-d3c1-4fad-bcfb-d4fdef35e0d6 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:31.434893 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.wsgi [None req-fb4eeb37-d3c1-4fad-bcfb-d4fdef35e0d6 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] HTTP exception thrown: Instance 9f32bcc7-80dd-457b-a908-9ae46c3d923d could not be found. Aug 03 05:25:31.436451 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-fb4eeb37-d3c1-4fad-bcfb-d4fdef35e0d6 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Request method failure captured: Aug 03 05:25:31.436451 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: request: DELETE /compute/v2.1/servers/9f32bcc7-80dd-457b-a908-9ae46c3d923d HTTP/1.1 Aug 03 05:25:31.436451 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Accept: application/json Aug 03 05:25:31.436451 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Accept-Encoding: identity Aug 03 05:25:31.436451 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Connection: close Aug 03 05:25:31.436451 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Content-Length: 0 Aug 03 05:25:31.436451 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Content-Type: application/json Aug 03 05:25:31.436451 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Host: 10.222.0.40 Aug 03 05:25:31.436451 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Openstack-System-Scope: None Aug 03 05:25:31.436451 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: User-Agent: python-urllib3/1.26.10 Aug 03 05:25:31.436451 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Auth-Token: gAAAAABi6gW1r7_81Momgb9V-Pc_vaYPdWIEuBDrgd0bdt0JL5T9I4c2oaDN-tUUEDsquQZmmEtcUgaXB4e8p9ZfKilfQ3apGdtd4ucRlv8R2i8xepw63Jaug8YDHRv4HToMeBhksVOaOx18akgjOb1gnyi4ud6p4nKX_aDqks7lJc8JWWzNrtc Aug 03 05:25:31.436451 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Domain-Id: None Aug 03 05:25:31.436451 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Domain-Name: None Aug 03 05:25:31.436451 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Identity-Status: Confirmed Aug 03 05:25:31.436451 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Is-Admin-Project: True Aug 03 05:25:31.436451 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Domain-Id: default Aug 03 05:25:31.436451 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Domain-Name: Default Aug 03 05:25:31.436451 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Id: 041a553912c64de981d9f87b551c190f Aug 03 05:25:31.436451 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Name: tempest-AttachVolumeNegativeTest-1549219107 Aug 03 05:25:31.436451 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Role: member,reader Aug 03 05:25:31.436451 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Roles: member,reader Aug 03 05:25:31.438087 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_041a553912c64de981d9f87b551c190f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/041a553912c64de981d9f87b551c190f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/041a553912c64de981d9f87b551c190f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/041a553912c64de981d9f87b551c190f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:25:31.438087 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant: tempest-AttachVolumeNegativeTest-1549219107 Aug 03 05:25:31.438087 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant-Id: 041a553912c64de981d9f87b551c190f Aug 03 05:25:31.438087 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1549219107 Aug 03 05:25:31.438087 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User: tempest-AttachVolumeNegativeTest-1549219107-project Aug 03 05:25:31.438087 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Domain-Id: default Aug 03 05:25:31.438087 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Domain-Name: Default Aug 03 05:25:31.438087 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Id: 729a6d00e1664a6298088e52de9999f5 Aug 03 05:25:31.438087 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Name: tempest-AttachVolumeNegativeTest-1549219107-project Aug 03 05:25:31.438087 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: method: > Aug 03 05:25:31.438087 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: exception: Instance 9f32bcc7-80dd-457b-a908-9ae46c3d923d could not be found. Aug 03 05:25:31.438087 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: action_args: {'id': '9f32bcc7-80dd-457b-a908-9ae46c3d923d'} Aug 03 05:25:31.442400 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:25:31.442400 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:25:31.442400 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:25:31.442400 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:25:31.442400 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:25:31.442400 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:25:31.442400 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:25:31.442400 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:25:31.442400 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:25:31.442400 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:25:31.442400 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f32bcc7-80dd-457b-a908-9ae46c3d923d could not be found. Aug 03 05:25:31.442400 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:25:31.442400 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:25:31.442400 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:25:31.442400 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:25:31.442400 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:25:31.442400 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:25:31.442400 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:25:31.442400 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:25:31.442400 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:25:31.444070 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:25:31.444070 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 05:25:31.444070 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 05:25:31.444070 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 05:25:31.444070 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 05:25:31.444070 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:25:31.444070 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:25:31.444070 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:25:31.444070 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:25:31.444070 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f32bcc7-80dd-457b-a908-9ae46c3d923d could not be found. Aug 03 05:25:31.444070 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:25:31.444070 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:25:31.444070 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:25:31.444070 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:25:31.444070 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:25:31.444070 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:25:31.444070 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:25:31.444070 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:25:31.444070 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f32bcc7-80dd-457b-a908-9ae46c3d923d could not be found. Aug 03 05:25:31.444070 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:25:31.445716 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-fb4eeb37-d3c1-4fad-bcfb-d4fdef35e0d6 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Returning 404 to user: Instance 9f32bcc7-80dd-457b-a908-9ae46c3d923d could not be found. {{(pid=118331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:25:31.445716 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-fb4eeb37-d3c1-4fad-bcfb-d4fdef35e0d6 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9f32bcc7-80dd-457b-a908-9ae46c3d923d" status: 404 len: 111 microversion: 2.1 time: 0.029330 Aug 03 05:25:31.445716 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 562/1091] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Aug 3 05:25:31 2022] DELETE /compute/v2.1/servers/9f32bcc7-80dd-457b-a908-9ae46c3d923d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:25:31.446524 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-afd1324b-725a-4957-9d0d-c31884dfd29e tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:25:31.447173 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-afd1324b-725a-4957-9d0d-c31884dfd29e tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 9f32bcc7-80dd-457b-a908-9ae46c3d923d] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:25:31.453160 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-afd1324b-725a-4957-9d0d-c31884dfd29e tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:31.453614 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-afd1324b-725a-4957-9d0d-c31884dfd29e tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:31.454391 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-afd1324b-725a-4957-9d0d-c31884dfd29e tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:31.454835 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-afd1324b-725a-4957-9d0d-c31884dfd29e tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:31.468666 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.wsgi [None req-afd1324b-725a-4957-9d0d-c31884dfd29e tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] HTTP exception thrown: Instance 9f32bcc7-80dd-457b-a908-9ae46c3d923d could not be found. Aug 03 05:25:31.470280 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-afd1324b-725a-4957-9d0d-c31884dfd29e tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Request method failure captured: Aug 03 05:25:31.470280 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: request: GET /compute/v2.1/servers/9f32bcc7-80dd-457b-a908-9ae46c3d923d HTTP/1.1 Aug 03 05:25:31.470280 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Accept: application/json Aug 03 05:25:31.470280 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Accept-Encoding: identity Aug 03 05:25:31.470280 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Connection: close Aug 03 05:25:31.470280 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Content-Length: 0 Aug 03 05:25:31.470280 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Content-Type: application/json Aug 03 05:25:31.470280 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Host: 10.222.0.40 Aug 03 05:25:31.470280 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Openstack-System-Scope: None Aug 03 05:25:31.470280 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: User-Agent: python-urllib3/1.26.10 Aug 03 05:25:31.470280 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Auth-Token: gAAAAABi6gW1r7_81Momgb9V-Pc_vaYPdWIEuBDrgd0bdt0JL5T9I4c2oaDN-tUUEDsquQZmmEtcUgaXB4e8p9ZfKilfQ3apGdtd4ucRlv8R2i8xepw63Jaug8YDHRv4HToMeBhksVOaOx18akgjOb1gnyi4ud6p4nKX_aDqks7lJc8JWWzNrtc Aug 03 05:25:31.470280 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Domain-Id: None Aug 03 05:25:31.470280 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Domain-Name: None Aug 03 05:25:31.470280 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Identity-Status: Confirmed Aug 03 05:25:31.470280 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Is-Admin-Project: True Aug 03 05:25:31.470280 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Domain-Id: default Aug 03 05:25:31.470280 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Domain-Name: Default Aug 03 05:25:31.470280 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Id: 041a553912c64de981d9f87b551c190f Aug 03 05:25:31.470280 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Name: tempest-AttachVolumeNegativeTest-1549219107 Aug 03 05:25:31.470280 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Role: member,reader Aug 03 05:25:31.470280 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Roles: member,reader Aug 03 05:25:31.471897 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_041a553912c64de981d9f87b551c190f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/041a553912c64de981d9f87b551c190f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/041a553912c64de981d9f87b551c190f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/041a553912c64de981d9f87b551c190f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:25:31.471897 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant: tempest-AttachVolumeNegativeTest-1549219107 Aug 03 05:25:31.471897 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant-Id: 041a553912c64de981d9f87b551c190f Aug 03 05:25:31.471897 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1549219107 Aug 03 05:25:31.471897 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User: tempest-AttachVolumeNegativeTest-1549219107-project Aug 03 05:25:31.471897 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Domain-Id: default Aug 03 05:25:31.471897 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Domain-Name: Default Aug 03 05:25:31.471897 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Id: 729a6d00e1664a6298088e52de9999f5 Aug 03 05:25:31.471897 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Name: tempest-AttachVolumeNegativeTest-1549219107-project Aug 03 05:25:31.471897 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: method: > Aug 03 05:25:31.471897 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: exception: Instance 9f32bcc7-80dd-457b-a908-9ae46c3d923d could not be found. Aug 03 05:25:31.471897 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: action_args: {'id': '9f32bcc7-80dd-457b-a908-9ae46c3d923d'} Aug 03 05:25:31.472738 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:25:31.472738 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:25:31.472738 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:25:31.472738 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:25:31.472738 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:25:31.472738 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:25:31.472738 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:25:31.472738 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:25:31.472738 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:25:31.472738 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:25:31.472738 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f32bcc7-80dd-457b-a908-9ae46c3d923d could not be found. Aug 03 05:25:31.472738 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:31.472738 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:25:31.472738 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:31.472738 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:25:31.472738 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:25:31.472738 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:25:31.472738 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:25:31.472738 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:25:31.472738 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:25:31.474091 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:25:31.474091 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:25:31.474091 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:25:31.474091 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:25:31.474091 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:25:31.474091 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:25:31.474091 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:25:31.474091 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f32bcc7-80dd-457b-a908-9ae46c3d923d could not be found. Aug 03 05:25:31.474091 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:31.474091 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:25:31.474091 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:31.474091 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:25:31.474091 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:25:31.474091 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:25:31.474091 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:25:31.474091 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:25:31.474091 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f32bcc7-80dd-457b-a908-9ae46c3d923d could not be found. Aug 03 05:25:31.474091 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:31.485160 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-afd1324b-725a-4957-9d0d-c31884dfd29e tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Returning 404 to user: Instance 9f32bcc7-80dd-457b-a908-9ae46c3d923d could not be found. {{(pid=118332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:25:31.485160 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-afd1324b-725a-4957-9d0d-c31884dfd29e tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/9f32bcc7-80dd-457b-a908-9ae46c3d923d" status: 404 len: 111 microversion: 2.1 time: 0.028987 Aug 03 05:25:31.485160 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 530/1092] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:25:31 2022] GET /compute/v2.1/servers/9f32bcc7-80dd-457b-a908-9ae46c3d923d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 05:25:31.680929 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-cbd9794a-05e2-4d4b-b824-bae3572bb261 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:25:31.681773 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-cbd9794a-05e2-4d4b-b824-bae3572bb261 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: adbab481-7f3a-4430-be8a-4429a6e46b4f] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:25:31.690328 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-cbd9794a-05e2-4d4b-b824-bae3572bb261 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:31.694011 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-cbd9794a-05e2-4d4b-b824-bae3572bb261 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:31.694902 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-cbd9794a-05e2-4d4b-b824-bae3572bb261 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:31.695348 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-cbd9794a-05e2-4d4b-b824-bae3572bb261 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:31.919352 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-cbd9794a-05e2-4d4b-b824-bae3572bb261 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3954ab39014ef3819111a6fe8142b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c986ef0f5ea46f9b5e788aaca042b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:25:31.926987 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-cbd9794a-05e2-4d4b-b824-bae3572bb261 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/adbab481-7f3a-4430-be8a-4429a6e46b4f" status: 200 len: 1266 microversion: 2.1 time: 0.250664 Aug 03 05:25:31.927557 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 563/1093] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:25:31 2022] GET /compute/v2.1/servers/adbab481-7f3a-4430-be8a-4429a6e46b4f => generated 1266 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:25:32.774700 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-3ffb0ab4-ca83-4b71-82a0-7ea71c933bbf tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:25:32.775229 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-3ffb0ab4-ca83-4b71-82a0-7ea71c933bbf tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 29be3e63-53b2-4e8f-b006-551a1b12c8a7] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:25:32.781723 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3ffb0ab4-ca83-4b71-82a0-7ea71c933bbf tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:32.782184 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3ffb0ab4-ca83-4b71-82a0-7ea71c933bbf tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:32.783003 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3ffb0ab4-ca83-4b71-82a0-7ea71c933bbf tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:32.783394 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-3ffb0ab4-ca83-4b71-82a0-7ea71c933bbf tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:32.796540 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.wsgi [None req-3ffb0ab4-ca83-4b71-82a0-7ea71c933bbf tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] HTTP exception thrown: Instance 29be3e63-53b2-4e8f-b006-551a1b12c8a7 could not be found. Aug 03 05:25:32.798204 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-3ffb0ab4-ca83-4b71-82a0-7ea71c933bbf tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Request method failure captured: Aug 03 05:25:32.798204 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: request: DELETE /compute/v2.1/servers/29be3e63-53b2-4e8f-b006-551a1b12c8a7 HTTP/1.1 Aug 03 05:25:32.798204 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Accept: application/json Aug 03 05:25:32.798204 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Accept-Encoding: identity Aug 03 05:25:32.798204 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Connection: close Aug 03 05:25:32.798204 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Content-Length: 0 Aug 03 05:25:32.798204 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Content-Type: application/json Aug 03 05:25:32.798204 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Host: 10.222.0.40 Aug 03 05:25:32.798204 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Openstack-System-Scope: None Aug 03 05:25:32.798204 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: User-Agent: python-urllib3/1.26.10 Aug 03 05:25:32.798204 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Auth-Token: gAAAAABi6gW1r7_81Momgb9V-Pc_vaYPdWIEuBDrgd0bdt0JL5T9I4c2oaDN-tUUEDsquQZmmEtcUgaXB4e8p9ZfKilfQ3apGdtd4ucRlv8R2i8xepw63Jaug8YDHRv4HToMeBhksVOaOx18akgjOb1gnyi4ud6p4nKX_aDqks7lJc8JWWzNrtc Aug 03 05:25:32.798204 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Domain-Id: None Aug 03 05:25:32.798204 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Domain-Name: None Aug 03 05:25:32.798204 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Identity-Status: Confirmed Aug 03 05:25:32.798204 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Is-Admin-Project: True Aug 03 05:25:32.798204 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Domain-Id: default Aug 03 05:25:32.798204 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Domain-Name: Default Aug 03 05:25:32.798204 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Id: 041a553912c64de981d9f87b551c190f Aug 03 05:25:32.798204 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Name: tempest-AttachVolumeNegativeTest-1549219107 Aug 03 05:25:32.798204 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Role: member,reader Aug 03 05:25:32.798204 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Roles: member,reader Aug 03 05:25:32.799878 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_041a553912c64de981d9f87b551c190f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/041a553912c64de981d9f87b551c190f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/041a553912c64de981d9f87b551c190f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/041a553912c64de981d9f87b551c190f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:25:32.799878 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant: tempest-AttachVolumeNegativeTest-1549219107 Aug 03 05:25:32.799878 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant-Id: 041a553912c64de981d9f87b551c190f Aug 03 05:25:32.799878 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1549219107 Aug 03 05:25:32.799878 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User: tempest-AttachVolumeNegativeTest-1549219107-project Aug 03 05:25:32.799878 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Domain-Id: default Aug 03 05:25:32.799878 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Domain-Name: Default Aug 03 05:25:32.799878 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Id: 729a6d00e1664a6298088e52de9999f5 Aug 03 05:25:32.799878 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Name: tempest-AttachVolumeNegativeTest-1549219107-project Aug 03 05:25:32.799878 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: method: > Aug 03 05:25:32.799878 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: exception: Instance 29be3e63-53b2-4e8f-b006-551a1b12c8a7 could not be found. Aug 03 05:25:32.799878 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: action_args: {'id': '29be3e63-53b2-4e8f-b006-551a1b12c8a7'} Aug 03 05:25:32.800844 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:25:32.800844 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:25:32.800844 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:25:32.800844 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:25:32.800844 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:25:32.800844 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:25:32.800844 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:25:32.800844 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:25:32.800844 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:25:32.800844 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:25:32.800844 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29be3e63-53b2-4e8f-b006-551a1b12c8a7 could not be found. Aug 03 05:25:32.800844 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:32.800844 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:25:32.800844 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:32.800844 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:25:32.800844 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:25:32.800844 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:25:32.800844 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:25:32.800844 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:25:32.800844 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:25:32.802375 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:25:32.802375 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 05:25:32.802375 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 05:25:32.802375 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 05:25:32.802375 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 05:25:32.802375 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:25:32.802375 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:25:32.802375 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:25:32.802375 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:25:32.802375 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29be3e63-53b2-4e8f-b006-551a1b12c8a7 could not be found. Aug 03 05:25:32.802375 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:32.802375 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:25:32.802375 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:32.802375 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:25:32.802375 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:25:32.802375 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:25:32.802375 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:25:32.802375 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:25:32.802375 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29be3e63-53b2-4e8f-b006-551a1b12c8a7 could not be found. Aug 03 05:25:32.802375 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:32.804453 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-3ffb0ab4-ca83-4b71-82a0-7ea71c933bbf tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Returning 404 to user: Instance 29be3e63-53b2-4e8f-b006-551a1b12c8a7 could not be found. {{(pid=118332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:25:32.804453 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-3ffb0ab4-ca83-4b71-82a0-7ea71c933bbf tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "DELETE /compute/v2.1/servers/29be3e63-53b2-4e8f-b006-551a1b12c8a7" status: 404 len: 111 microversion: 2.1 time: 0.028603 Aug 03 05:25:32.804453 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 531/1094] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Aug 3 05:25:32 2022] DELETE /compute/v2.1/servers/29be3e63-53b2-4e8f-b006-551a1b12c8a7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:25:32.808549 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-c4eb22d6-0641-4c52-850f-d5cb5ee46392 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:25:32.817570 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-c4eb22d6-0641-4c52-850f-d5cb5ee46392 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] [instance: 29be3e63-53b2-4e8f-b006-551a1b12c8a7] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:25:32.817570 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c4eb22d6-0641-4c52-850f-d5cb5ee46392 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:32.817570 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c4eb22d6-0641-4c52-850f-d5cb5ee46392 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:32.817570 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c4eb22d6-0641-4c52-850f-d5cb5ee46392 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:32.817990 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c4eb22d6-0641-4c52-850f-d5cb5ee46392 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:32.833350 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.wsgi [None req-c4eb22d6-0641-4c52-850f-d5cb5ee46392 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] HTTP exception thrown: Instance 29be3e63-53b2-4e8f-b006-551a1b12c8a7 could not be found. Aug 03 05:25:32.834918 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-c4eb22d6-0641-4c52-850f-d5cb5ee46392 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Request method failure captured: Aug 03 05:25:32.834918 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: request: GET /compute/v2.1/servers/29be3e63-53b2-4e8f-b006-551a1b12c8a7 HTTP/1.1 Aug 03 05:25:32.834918 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Accept: application/json Aug 03 05:25:32.834918 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Accept-Encoding: identity Aug 03 05:25:32.834918 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Connection: close Aug 03 05:25:32.834918 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Content-Length: 0 Aug 03 05:25:32.834918 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Content-Type: application/json Aug 03 05:25:32.834918 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Host: 10.222.0.40 Aug 03 05:25:32.834918 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Openstack-System-Scope: None Aug 03 05:25:32.834918 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: User-Agent: python-urllib3/1.26.10 Aug 03 05:25:32.834918 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Auth-Token: gAAAAABi6gW1r7_81Momgb9V-Pc_vaYPdWIEuBDrgd0bdt0JL5T9I4c2oaDN-tUUEDsquQZmmEtcUgaXB4e8p9ZfKilfQ3apGdtd4ucRlv8R2i8xepw63Jaug8YDHRv4HToMeBhksVOaOx18akgjOb1gnyi4ud6p4nKX_aDqks7lJc8JWWzNrtc Aug 03 05:25:32.834918 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Domain-Id: None Aug 03 05:25:32.834918 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Domain-Name: None Aug 03 05:25:32.834918 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Identity-Status: Confirmed Aug 03 05:25:32.834918 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Is-Admin-Project: True Aug 03 05:25:32.834918 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Domain-Id: default Aug 03 05:25:32.834918 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Domain-Name: Default Aug 03 05:25:32.834918 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Id: 041a553912c64de981d9f87b551c190f Aug 03 05:25:32.834918 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Name: tempest-AttachVolumeNegativeTest-1549219107 Aug 03 05:25:32.834918 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Role: member,reader Aug 03 05:25:32.834918 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Roles: member,reader Aug 03 05:25:32.836540 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_041a553912c64de981d9f87b551c190f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/041a553912c64de981d9f87b551c190f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/041a553912c64de981d9f87b551c190f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/041a553912c64de981d9f87b551c190f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:25:32.836540 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant: tempest-AttachVolumeNegativeTest-1549219107 Aug 03 05:25:32.836540 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant-Id: 041a553912c64de981d9f87b551c190f Aug 03 05:25:32.836540 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1549219107 Aug 03 05:25:32.836540 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User: tempest-AttachVolumeNegativeTest-1549219107-project Aug 03 05:25:32.836540 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Domain-Id: default Aug 03 05:25:32.836540 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Domain-Name: Default Aug 03 05:25:32.836540 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Id: 729a6d00e1664a6298088e52de9999f5 Aug 03 05:25:32.836540 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Name: tempest-AttachVolumeNegativeTest-1549219107-project Aug 03 05:25:32.836540 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: method: > Aug 03 05:25:32.836540 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: exception: Instance 29be3e63-53b2-4e8f-b006-551a1b12c8a7 could not be found. Aug 03 05:25:32.836540 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: action_args: {'id': '29be3e63-53b2-4e8f-b006-551a1b12c8a7'} Aug 03 05:25:32.837522 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:25:32.837522 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:25:32.837522 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:25:32.837522 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:25:32.837522 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:25:32.837522 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:25:32.837522 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:25:32.837522 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:25:32.837522 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:25:32.837522 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:25:32.837522 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29be3e63-53b2-4e8f-b006-551a1b12c8a7 could not be found. Aug 03 05:25:32.837522 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:25:32.837522 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:25:32.837522 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:25:32.837522 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:25:32.837522 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:25:32.837522 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:25:32.837522 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:25:32.837522 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:25:32.837522 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:25:32.838794 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:25:32.838794 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:25:32.838794 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:25:32.838794 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:25:32.838794 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:25:32.838794 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:25:32.838794 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:25:32.838794 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29be3e63-53b2-4e8f-b006-551a1b12c8a7 could not be found. Aug 03 05:25:32.838794 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:25:32.838794 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:25:32.838794 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:25:32.838794 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:25:32.838794 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:25:32.838794 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:25:32.838794 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:25:32.838794 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:25:32.838794 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29be3e63-53b2-4e8f-b006-551a1b12c8a7 could not be found. Aug 03 05:25:32.838794 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:25:32.839960 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-c4eb22d6-0641-4c52-850f-d5cb5ee46392 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] Returning 404 to user: Instance 29be3e63-53b2-4e8f-b006-551a1b12c8a7 could not be found. {{(pid=118331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:25:32.839960 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-c4eb22d6-0641-4c52-850f-d5cb5ee46392 tempest-AttachVolumeNegativeTest-1549219107 tempest-AttachVolumeNegativeTest-1549219107-project] 10.222.0.40 "GET /compute/v2.1/servers/29be3e63-53b2-4e8f-b006-551a1b12c8a7" status: 404 len: 111 microversion: 2.1 time: 0.031836 Aug 03 05:25:32.839960 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 564/1095] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:25:32 2022] GET /compute/v2.1/servers/29be3e63-53b2-4e8f-b006-551a1b12c8a7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:25:32.949211 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-5b21835f-553b-4f02-8e20-62d8e5404c34 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:25:32.949743 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-5b21835f-553b-4f02-8e20-62d8e5404c34 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: adbab481-7f3a-4430-be8a-4429a6e46b4f] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:25:32.955886 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-5b21835f-553b-4f02-8e20-62d8e5404c34 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:32.956347 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-5b21835f-553b-4f02-8e20-62d8e5404c34 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:32.957120 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-5b21835f-553b-4f02-8e20-62d8e5404c34 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:32.957564 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-5b21835f-553b-4f02-8e20-62d8e5404c34 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:33.089256 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-5b21835f-553b-4f02-8e20-62d8e5404c34 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3954ab39014ef3819111a6fe8142b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c986ef0f5ea46f9b5e788aaca042b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:25:33.097124 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-5b21835f-553b-4f02-8e20-62d8e5404c34 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/adbab481-7f3a-4430-be8a-4429a6e46b4f" status: 200 len: 1266 microversion: 2.1 time: 0.151849 Aug 03 05:25:33.097696 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 532/1096] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:25:32 2022] GET /compute/v2.1/servers/adbab481-7f3a-4430-be8a-4429a6e46b4f => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:25:34.118134 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-fb05cb65-4cf0-4c48-b7fa-cf6abcb3045a tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:25:34.118749 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-fb05cb65-4cf0-4c48-b7fa-cf6abcb3045a tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: adbab481-7f3a-4430-be8a-4429a6e46b4f] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:25:34.125224 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fb05cb65-4cf0-4c48-b7fa-cf6abcb3045a tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:34.125679 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fb05cb65-4cf0-4c48-b7fa-cf6abcb3045a tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:34.126458 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fb05cb65-4cf0-4c48-b7fa-cf6abcb3045a tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:34.126968 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fb05cb65-4cf0-4c48-b7fa-cf6abcb3045a tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:34.270447 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-fb05cb65-4cf0-4c48-b7fa-cf6abcb3045a tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3954ab39014ef3819111a6fe8142b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c986ef0f5ea46f9b5e788aaca042b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:25:34.279173 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-fb05cb65-4cf0-4c48-b7fa-cf6abcb3045a tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/adbab481-7f3a-4430-be8a-4429a6e46b4f" status: 200 len: 1266 microversion: 2.1 time: 0.164919 Aug 03 05:25:34.279764 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 565/1097] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:25:34 2022] GET /compute/v2.1/servers/adbab481-7f3a-4430-be8a-4429a6e46b4f => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:25:35.304305 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-a6331ed9-0f7b-41e7-9fce-ad166f0888df tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:25:35.304305 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-a6331ed9-0f7b-41e7-9fce-ad166f0888df tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: adbab481-7f3a-4430-be8a-4429a6e46b4f] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:25:35.307378 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-a6331ed9-0f7b-41e7-9fce-ad166f0888df tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:35.307835 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-a6331ed9-0f7b-41e7-9fce-ad166f0888df tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:35.308618 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-a6331ed9-0f7b-41e7-9fce-ad166f0888df tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:35.309062 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-a6331ed9-0f7b-41e7-9fce-ad166f0888df tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:35.454262 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-a6331ed9-0f7b-41e7-9fce-ad166f0888df tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3954ab39014ef3819111a6fe8142b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c986ef0f5ea46f9b5e788aaca042b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:25:35.462608 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-a6331ed9-0f7b-41e7-9fce-ad166f0888df tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/adbab481-7f3a-4430-be8a-4429a6e46b4f" status: 200 len: 1266 microversion: 2.1 time: 0.166591 Aug 03 05:25:35.463350 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 533/1098] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:25:35 2022] GET /compute/v2.1/servers/adbab481-7f3a-4430-be8a-4429a6e46b4f => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:25:36.483345 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-4d72ddb1-51c2-49b6-a91e-acca3dfc314c tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:25:36.483893 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-4d72ddb1-51c2-49b6-a91e-acca3dfc314c tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: adbab481-7f3a-4430-be8a-4429a6e46b4f] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:25:36.491373 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4d72ddb1-51c2-49b6-a91e-acca3dfc314c tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:36.493883 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4d72ddb1-51c2-49b6-a91e-acca3dfc314c tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:36.493883 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4d72ddb1-51c2-49b6-a91e-acca3dfc314c tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:36.493883 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4d72ddb1-51c2-49b6-a91e-acca3dfc314c tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:36.567182 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell0:SELECT=2 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:25:36.597132 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell0:SELECT=6 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:25:36.626191 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-4d72ddb1-51c2-49b6-a91e-acca3dfc314c tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3954ab39014ef3819111a6fe8142b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c986ef0f5ea46f9b5e788aaca042b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:25:36.633722 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-4d72ddb1-51c2-49b6-a91e-acca3dfc314c tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/adbab481-7f3a-4430-be8a-4429a6e46b4f" status: 200 len: 1266 microversion: 2.1 time: 0.154384 Aug 03 05:25:36.634294 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 566/1099] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:25:36 2022] GET /compute/v2.1/servers/adbab481-7f3a-4430-be8a-4429a6e46b4f => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:25:37.654602 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-4f5f31fd-993d-45e6-bf5e-e5f9756aeb3c tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:25:37.655420 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-4f5f31fd-993d-45e6-bf5e-e5f9756aeb3c tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: adbab481-7f3a-4430-be8a-4429a6e46b4f] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:25:37.657881 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_cell0:SELECT=2 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:25:37.665409 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-4f5f31fd-993d-45e6-bf5e-e5f9756aeb3c tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:37.665965 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-4f5f31fd-993d-45e6-bf5e-e5f9756aeb3c tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:37.666891 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-4f5f31fd-993d-45e6-bf5e-e5f9756aeb3c tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:37.667401 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-4f5f31fd-993d-45e6-bf5e-e5f9756aeb3c tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:37.805692 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-4f5f31fd-993d-45e6-bf5e-e5f9756aeb3c tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3954ab39014ef3819111a6fe8142b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c986ef0f5ea46f9b5e788aaca042b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:25:37.813087 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-4f5f31fd-993d-45e6-bf5e-e5f9756aeb3c tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/adbab481-7f3a-4430-be8a-4429a6e46b4f" status: 200 len: 1266 microversion: 2.1 time: 0.162416 Aug 03 05:25:37.813672 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 534/1100] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:25:37 2022] GET /compute/v2.1/servers/adbab481-7f3a-4430-be8a-4429a6e46b4f => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:25:38.120708 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-b299a8e9-b38d-4775-8c53-f277ec906fce tempest-VolumesSnapshotsTestJSON-1882007277 tempest-VolumesSnapshotsTestJSON-1882007277-project] Action: 'create', calling method: .version_select at 0x7f7602836310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1966458877"}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:25:38.633354 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-b299a8e9-b38d-4775-8c53-f277ec906fce tempest-VolumesSnapshotsTestJSON-1882007277 tempest-VolumesSnapshotsTestJSON-1882007277-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.648485 Aug 03 05:25:38.634180 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 567/1101] 10.222.0.40 () {60 vars in 1155 bytes} [Wed Aug 3 05:25:37 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 650 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 03 05:25:38.650358 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-8db13ab0-70fc-4f8a-a330-29c6336bde6c tempest-VolumesSnapshotsTestJSON-1882007277 tempest-VolumesSnapshotsTestJSON-1882007277-project] Calling method '.version_select at 0x7f7601dcf670>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:25:38.704266 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-8db13ab0-70fc-4f8a-a330-29c6336bde6c tempest-VolumesSnapshotsTestJSON-1882007277 tempest-VolumesSnapshotsTestJSON-1882007277-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/5b2c88e8-80be-4043-ac35-be2a438dcccd" status: 200 len: 345 microversion: 2.1 time: 0.058361 Aug 03 05:25:38.704834 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 535/1102] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Aug 3 05:25:38 2022] GET /compute/v2.1/os-volumes/5b2c88e8-80be-4043-ac35-be2a438dcccd => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:25:38.833745 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-270741bf-d689-4731-af8f-7f2e039a9d40 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:25:38.834467 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-270741bf-d689-4731-af8f-7f2e039a9d40 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: adbab481-7f3a-4430-be8a-4429a6e46b4f] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:25:38.841363 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-270741bf-d689-4731-af8f-7f2e039a9d40 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:38.841847 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-270741bf-d689-4731-af8f-7f2e039a9d40 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:38.842613 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-270741bf-d689-4731-af8f-7f2e039a9d40 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:38.843078 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-270741bf-d689-4731-af8f-7f2e039a9d40 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:38.975407 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-270741bf-d689-4731-af8f-7f2e039a9d40 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3954ab39014ef3819111a6fe8142b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c986ef0f5ea46f9b5e788aaca042b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:25:38.982759 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-270741bf-d689-4731-af8f-7f2e039a9d40 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/adbab481-7f3a-4430-be8a-4429a6e46b4f" status: 200 len: 1266 microversion: 2.1 time: 0.153049 Aug 03 05:25:38.983349 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 568/1103] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:25:38 2022] GET /compute/v2.1/servers/adbab481-7f3a-4430-be8a-4429a6e46b4f => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:25:39.719449 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-539f963f-6f3f-4ee1-8bf2-18d512fff01a tempest-VolumesSnapshotsTestJSON-1882007277 tempest-VolumesSnapshotsTestJSON-1882007277-project] Calling method '.version_select at 0x7f7601e739d0>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:25:39.765672 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-539f963f-6f3f-4ee1-8bf2-18d512fff01a tempest-VolumesSnapshotsTestJSON-1882007277 tempest-VolumesSnapshotsTestJSON-1882007277-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/5b2c88e8-80be-4043-ac35-be2a438dcccd" status: 200 len: 346 microversion: 2.1 time: 0.050534 Aug 03 05:25:39.766325 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 536/1104] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Aug 3 05:25:39 2022] GET /compute/v2.1/os-volumes/5b2c88e8-80be-4043-ac35-be2a438dcccd => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:25:39.778471 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-717aeb7a-3127-4cc6-bfe1-35871a8a293a tempest-VolumesSnapshotsTestJSON-1882007277 tempest-VolumesSnapshotsTestJSON-1882007277-project] Action: 'create', calling method: .version_select at 0x7f7602843d30>, body: {"snapshot": {"volume_id": "5b2c88e8-80be-4043-ac35-be2a438dcccd", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2021281897"}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:25:40.003512 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-41db439c-07e8-454e-a8e5-c0372267f934 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:25:40.004154 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-41db439c-07e8-454e-a8e5-c0372267f934 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: adbab481-7f3a-4430-be8a-4429a6e46b4f] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:25:40.011018 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-41db439c-07e8-454e-a8e5-c0372267f934 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:40.011474 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-41db439c-07e8-454e-a8e5-c0372267f934 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:40.012240 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-41db439c-07e8-454e-a8e5-c0372267f934 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:40.012678 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-41db439c-07e8-454e-a8e5-c0372267f934 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:40.151713 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-41db439c-07e8-454e-a8e5-c0372267f934 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3954ab39014ef3819111a6fe8142b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c986ef0f5ea46f9b5e788aaca042b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:25:40.159180 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-41db439c-07e8-454e-a8e5-c0372267f934 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/adbab481-7f3a-4430-be8a-4429a6e46b4f" status: 200 len: 1266 microversion: 2.1 time: 0.159514 Aug 03 05:25:40.159760 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 537/1105] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:25:39 2022] GET /compute/v2.1/servers/adbab481-7f3a-4430-be8a-4429a6e46b4f => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:25:40.251767 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-717aeb7a-3127-4cc6-bfe1-35871a8a293a tempest-VolumesSnapshotsTestJSON-1882007277 tempest-VolumesSnapshotsTestJSON-1882007277-project] 10.222.0.40 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.477002 Aug 03 05:25:40.252384 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 569/1106] 10.222.0.40 () {60 vars in 1162 bytes} [Wed Aug 3 05:25:39 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:25:40.263039 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-2bb619d7-77b6-453e-a5dc-b43139c498f2 tempest-VolumesSnapshotsTestJSON-1882007277 tempest-VolumesSnapshotsTestJSON-1882007277-project] Calling method '.version_select at 0x7f7601dcf1f0>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:25:40.294082 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-2bb619d7-77b6-453e-a5dc-b43139c498f2 tempest-VolumesSnapshotsTestJSON-1882007277 tempest-VolumesSnapshotsTestJSON-1882007277-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/eeefddb5-a5e5-43d4-9f4d-6de4273cd891" status: 200 len: 287 microversion: 2.1 time: 0.034844 Aug 03 05:25:40.294653 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 538/1107] 10.222.0.40 () {58 vars in 1251 bytes} [Wed Aug 3 05:25:40 2022] GET /compute/v2.1/os-snapshots/eeefddb5-a5e5-43d4-9f4d-6de4273cd891 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:25:40.306051 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-9da31b0f-c253-456f-958d-9b701c26d8f5 tempest-VolumesSnapshotsTestJSON-1882007277 tempest-VolumesSnapshotsTestJSON-1882007277-project] Calling method '.version_select at 0x7f7601ff8c10>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:25:40.337805 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-9da31b0f-c253-456f-958d-9b701c26d8f5 tempest-VolumesSnapshotsTestJSON-1882007277 tempest-VolumesSnapshotsTestJSON-1882007277-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.036275 Aug 03 05:25:40.338571 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 570/1108] 10.222.0.40 () {58 vars in 1140 bytes} [Wed Aug 3 05:25:40 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:25:40.349619 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-94eedacc-3917-4bb9-af28-3a6fe13478ce tempest-VolumesSnapshotsTestJSON-1882007277 tempest-VolumesSnapshotsTestJSON-1882007277-project] Calling method '.version_select at 0x7f7601ec4e50>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:25:40.384288 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-94eedacc-3917-4bb9-af28-3a6fe13478ce tempest-VolumesSnapshotsTestJSON-1882007277 tempest-VolumesSnapshotsTestJSON-1882007277-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/eeefddb5-a5e5-43d4-9f4d-6de4273cd891" status: 200 len: 287 microversion: 2.1 time: 0.038810 Aug 03 05:25:40.384890 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 539/1109] 10.222.0.40 () {58 vars in 1251 bytes} [Wed Aug 3 05:25:40 2022] GET /compute/v2.1/os-snapshots/eeefddb5-a5e5-43d4-9f4d-6de4273cd891 => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:25:41.181846 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-994570df-d50b-4a78-b87d-003ebf61d713 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:25:41.182474 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-994570df-d50b-4a78-b87d-003ebf61d713 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: adbab481-7f3a-4430-be8a-4429a6e46b4f] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:25:41.188679 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-994570df-d50b-4a78-b87d-003ebf61d713 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:41.189137 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-994570df-d50b-4a78-b87d-003ebf61d713 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:41.189943 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-994570df-d50b-4a78-b87d-003ebf61d713 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:41.190389 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-994570df-d50b-4a78-b87d-003ebf61d713 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:41.324651 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-994570df-d50b-4a78-b87d-003ebf61d713 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3954ab39014ef3819111a6fe8142b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c986ef0f5ea46f9b5e788aaca042b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:25:41.332273 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-994570df-d50b-4a78-b87d-003ebf61d713 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/adbab481-7f3a-4430-be8a-4429a6e46b4f" status: 200 len: 1266 microversion: 2.1 time: 0.155392 Aug 03 05:25:41.332846 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 571/1110] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:25:41 2022] GET /compute/v2.1/servers/adbab481-7f3a-4430-be8a-4429a6e46b4f => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:25:41.400780 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-0179e370-5b17-4e7e-8f70-6a93090110a0 tempest-VolumesSnapshotsTestJSON-1882007277 tempest-VolumesSnapshotsTestJSON-1882007277-project] Calling method '.version_select at 0x7f7601c88af0>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:25:41.432179 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-0179e370-5b17-4e7e-8f70-6a93090110a0 tempest-VolumesSnapshotsTestJSON-1882007277 tempest-VolumesSnapshotsTestJSON-1882007277-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/eeefddb5-a5e5-43d4-9f4d-6de4273cd891" status: 200 len: 287 microversion: 2.1 time: 0.035611 Aug 03 05:25:41.432697 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 540/1111] 10.222.0.40 () {58 vars in 1251 bytes} [Wed Aug 3 05:25:41 2022] GET /compute/v2.1/os-snapshots/eeefddb5-a5e5-43d4-9f4d-6de4273cd891 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:25:42.353547 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-acb34180-6870-438e-a075-a16d49cdd7eb tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:25:42.354172 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-acb34180-6870-438e-a075-a16d49cdd7eb tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: adbab481-7f3a-4430-be8a-4429a6e46b4f] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:25:42.360718 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-acb34180-6870-438e-a075-a16d49cdd7eb tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:42.361172 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-acb34180-6870-438e-a075-a16d49cdd7eb tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:42.361935 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-acb34180-6870-438e-a075-a16d49cdd7eb tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:42.362379 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-acb34180-6870-438e-a075-a16d49cdd7eb tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:42.445329 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-f74df7c3-ca93-4477-9e47-4a74116e1ea7 tempest-VolumesSnapshotsTestJSON-1882007277 tempest-VolumesSnapshotsTestJSON-1882007277-project] Calling method '.version_select at 0x7f7601dcf940>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:25:42.475665 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-f74df7c3-ca93-4477-9e47-4a74116e1ea7 tempest-VolumesSnapshotsTestJSON-1882007277 tempest-VolumesSnapshotsTestJSON-1882007277-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/eeefddb5-a5e5-43d4-9f4d-6de4273cd891" status: 200 len: 287 microversion: 2.1 time: 0.034775 Aug 03 05:25:42.476237 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 541/1112] 10.222.0.40 () {58 vars in 1251 bytes} [Wed Aug 3 05:25:42 2022] GET /compute/v2.1/os-snapshots/eeefddb5-a5e5-43d4-9f4d-6de4273cd891 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:25:42.493793 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-acb34180-6870-438e-a075-a16d49cdd7eb tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3954ab39014ef3819111a6fe8142b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c986ef0f5ea46f9b5e788aaca042b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:25:42.501222 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-acb34180-6870-438e-a075-a16d49cdd7eb tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/adbab481-7f3a-4430-be8a-4429a6e46b4f" status: 200 len: 1266 microversion: 2.1 time: 0.152051 Aug 03 05:25:42.501808 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 572/1113] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:25:42 2022] GET /compute/v2.1/servers/adbab481-7f3a-4430-be8a-4429a6e46b4f => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:25:43.488789 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-49c1eb83-c5a9-4440-b34b-8063935aedcf tempest-VolumesSnapshotsTestJSON-1882007277 tempest-VolumesSnapshotsTestJSON-1882007277-project] Calling method '.version_select at 0x7f76020f7e50>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:25:43.518948 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-49c1eb83-c5a9-4440-b34b-8063935aedcf tempest-VolumesSnapshotsTestJSON-1882007277 tempest-VolumesSnapshotsTestJSON-1882007277-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/eeefddb5-a5e5-43d4-9f4d-6de4273cd891" status: 200 len: 288 microversion: 2.1 time: 0.034562 Aug 03 05:25:43.521558 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-25ee2e4e-4356-4fba-b01a-39903a8b6265 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:25:43.522706 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-25ee2e4e-4356-4fba-b01a-39903a8b6265 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: adbab481-7f3a-4430-be8a-4429a6e46b4f] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:25:43.525553 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 542/1114] 10.222.0.40 () {58 vars in 1251 bytes} [Wed Aug 3 05:25:43 2022] GET /compute/v2.1/os-snapshots/eeefddb5-a5e5-43d4-9f4d-6de4273cd891 => generated 288 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:25:43.529684 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-25ee2e4e-4356-4fba-b01a-39903a8b6265 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:43.530340 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-25ee2e4e-4356-4fba-b01a-39903a8b6265 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:43.530498 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-a97f2d6e-a89c-4052-8fb8-0d92719eafbd tempest-VolumesSnapshotsTestJSON-1882007277 tempest-VolumesSnapshotsTestJSON-1882007277-project] Calling method '.version_select at 0x7f7601e73790>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:25:43.531151 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-25ee2e4e-4356-4fba-b01a-39903a8b6265 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:43.531693 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-25ee2e4e-4356-4fba-b01a-39903a8b6265 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:43.537183 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:25:43.645041 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-a97f2d6e-a89c-4052-8fb8-0d92719eafbd tempest-VolumesSnapshotsTestJSON-1882007277 tempest-VolumesSnapshotsTestJSON-1882007277-project] 10.222.0.40 "DELETE /compute/v2.1/os-snapshots/eeefddb5-a5e5-43d4-9f4d-6de4273cd891" status: 202 len: 0 microversion: 2.1 time: 0.118203 Aug 03 05:25:43.646395 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 543/1115] 10.222.0.40 () {58 vars in 1254 bytes} [Wed Aug 3 05:25:43 2022] DELETE /compute/v2.1/os-snapshots/eeefddb5-a5e5-43d4-9f4d-6de4273cd891 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:25:43.653729 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-b295d18b-5860-4534-bc40-7ef63fe8a272 tempest-VolumesSnapshotsTestJSON-1882007277 tempest-VolumesSnapshotsTestJSON-1882007277-project] Calling method '.version_select at 0x7f7601e73550>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:25:43.685822 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-b295d18b-5860-4534-bc40-7ef63fe8a272 tempest-VolumesSnapshotsTestJSON-1882007277 tempest-VolumesSnapshotsTestJSON-1882007277-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/eeefddb5-a5e5-43d4-9f4d-6de4273cd891" status: 200 len: 287 microversion: 2.1 time: 0.035641 Aug 03 05:25:43.686464 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 544/1116] 10.222.0.40 () {58 vars in 1251 bytes} [Wed Aug 3 05:25:43 2022] GET /compute/v2.1/os-snapshots/eeefddb5-a5e5-43d4-9f4d-6de4273cd891 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:25:43.686796 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-25ee2e4e-4356-4fba-b01a-39903a8b6265 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3954ab39014ef3819111a6fe8142b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c986ef0f5ea46f9b5e788aaca042b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:25:43.694613 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-25ee2e4e-4356-4fba-b01a-39903a8b6265 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/adbab481-7f3a-4430-be8a-4429a6e46b4f" status: 200 len: 1266 microversion: 2.1 time: 0.176868 Aug 03 05:25:43.695219 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 573/1117] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:25:43 2022] GET /compute/v2.1/servers/adbab481-7f3a-4430-be8a-4429a6e46b4f => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:25:44.699600 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-92ecd146-e99f-4424-aed5-8f9a405dd8b3 tempest-VolumesSnapshotsTestJSON-1882007277 tempest-VolumesSnapshotsTestJSON-1882007277-project] Calling method '.version_select at 0x7f7601dcfc10>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:25:44.716887 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-dc7094a6-5414-47cc-adfe-3dfc423b5dcf tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:25:44.717505 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-dc7094a6-5414-47cc-adfe-3dfc423b5dcf tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: adbab481-7f3a-4430-be8a-4429a6e46b4f] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:25:44.724404 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.wsgi [None req-92ecd146-e99f-4424-aed5-8f9a405dd8b3 tempest-VolumesSnapshotsTestJSON-1882007277 tempest-VolumesSnapshotsTestJSON-1882007277-project] HTTP exception thrown: Snapshot eeefddb5-a5e5-43d4-9f4d-6de4273cd891 could not be found. Aug 03 05:25:44.725152 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-dc7094a6-5414-47cc-adfe-3dfc423b5dcf tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:44.725613 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-dc7094a6-5414-47cc-adfe-3dfc423b5dcf tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:44.726392 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-dc7094a6-5414-47cc-adfe-3dfc423b5dcf tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:44.726849 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-dc7094a6-5414-47cc-adfe-3dfc423b5dcf tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:44.727661 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-92ecd146-e99f-4424-aed5-8f9a405dd8b3 tempest-VolumesSnapshotsTestJSON-1882007277 tempest-VolumesSnapshotsTestJSON-1882007277-project] Request method failure captured: Aug 03 05:25:44.727661 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: request: GET /compute/v2.1/os-snapshots/eeefddb5-a5e5-43d4-9f4d-6de4273cd891 HTTP/1.1 Aug 03 05:25:44.727661 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Accept: application/json Aug 03 05:25:44.727661 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Accept-Encoding: identity Aug 03 05:25:44.727661 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Connection: close Aug 03 05:25:44.727661 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Content-Length: 0 Aug 03 05:25:44.727661 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Content-Type: application/json Aug 03 05:25:44.727661 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Host: 10.222.0.40 Aug 03 05:25:44.727661 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Openstack-System-Scope: None Aug 03 05:25:44.727661 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: User-Agent: python-urllib3/1.26.10 Aug 03 05:25:44.727661 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Auth-Token: gAAAAABi6gbRX16yF9iOgfxmdYgNhFB0bUPGaPDqvY1ZRXzwHDWw1lYGd6nv7e5GzrMSE8zFRIS54i9zXbq_M7SemaAon4hlKY3S9fN_z2u3a1lX7fxUgEdxY1aU-9VPiziw8IgGzds-LHE04opHr3RFFF5IfJYPY1RyAzUUI944CRW8nqUr7Ig Aug 03 05:25:44.727661 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Domain-Id: None Aug 03 05:25:44.727661 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Domain-Name: None Aug 03 05:25:44.727661 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Identity-Status: Confirmed Aug 03 05:25:44.727661 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Is-Admin-Project: True Aug 03 05:25:44.727661 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Domain-Id: default Aug 03 05:25:44.727661 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Domain-Name: Default Aug 03 05:25:44.727661 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Id: 4af419fadcee40c98ef886109624a631 Aug 03 05:25:44.727661 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1882007277 Aug 03 05:25:44.727661 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Role: member,reader Aug 03 05:25:44.727661 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Roles: member,reader Aug 03 05:25:44.729391 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4af419fadcee40c98ef886109624a631"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4af419fadcee40c98ef886109624a631"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4af419fadcee40c98ef886109624a631"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4af419fadcee40c98ef886109624a631"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:25:44.729391 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1882007277 Aug 03 05:25:44.729391 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant-Id: 4af419fadcee40c98ef886109624a631 Aug 03 05:25:44.729391 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1882007277 Aug 03 05:25:44.729391 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User: tempest-VolumesSnapshotsTestJSON-1882007277-project Aug 03 05:25:44.729391 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Domain-Id: default Aug 03 05:25:44.729391 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Domain-Name: Default Aug 03 05:25:44.729391 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Id: 4de01cf3881741068c9ca8061696ed2a Aug 03 05:25:44.729391 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1882007277-project Aug 03 05:25:44.729391 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: method: Aug 03 05:25:44.729391 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: exception: Snapshot eeefddb5-a5e5-43d4-9f4d-6de4273cd891 could not be found. Aug 03 05:25:44.729391 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: action_args: {'id': 'eeefddb5-a5e5-43d4-9f4d-6de4273cd891'} Aug 03 05:25:44.729391 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:25:44.730493 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:25:44.730493 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 03 05:25:44.730493 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 03 05:25:44.730493 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 03 05:25:44.730493 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 03 05:25:44.730493 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 03 05:25:44.730493 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 03 05:25:44.730493 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 05:25:44.730493 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 05:25:44.730493 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 05:25:44.730493 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 05:25:44.730493 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 05:25:44.730493 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 05:25:44.730493 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 05:25:44.730493 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 05:25:44.730493 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot eeefddb5-a5e5-43d4-9f4d-6de4273cd891 could not be found. (HTTP 404) (Request-ID: req-d62e8d11-ce76-4528-8266-59c9708fc36c) Aug 03 05:25:44.730493 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:44.730493 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:25:44.732029 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:44.732029 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:25:44.732029 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 03 05:25:44.732029 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 03 05:25:44.732029 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 05:25:44.732029 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 05:25:44.732029 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 03 05:25:44.732029 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 03 05:25:44.732029 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 05:25:44.732029 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 05:25:44.732029 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 03 05:25:44.732029 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 03 05:25:44.732029 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 03 05:25:44.732029 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 03 05:25:44.732029 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 03 05:25:44.732029 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 03 05:25:44.732029 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 05:25:44.732029 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 05:25:44.732029 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 05:25:44.733510 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 05:25:44.733510 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 05:25:44.733510 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 05:25:44.733510 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 05:25:44.733510 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 05:25:44.733510 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot eeefddb5-a5e5-43d4-9f4d-6de4273cd891 could not be found. Aug 03 05:25:44.733510 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:44.733510 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:25:44.733510 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:44.733510 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:25:44.733510 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:25:44.733510 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:25:44.733510 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:25:44.733510 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:25:44.733510 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 05:25:44.733510 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 05:25:44.733510 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:25:44.733510 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:25:44.733510 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 03 05:25:44.733510 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:25:44.735103 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot eeefddb5-a5e5-43d4-9f4d-6de4273cd891 could not be found. Aug 03 05:25:44.735103 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:44.735103 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:25:44.735103 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:44.735103 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:25:44.735103 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:25:44.735103 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:25:44.735103 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:25:44.735103 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:25:44.735103 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot eeefddb5-a5e5-43d4-9f4d-6de4273cd891 could not be found. Aug 03 05:25:44.735103 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:44.735103 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-92ecd146-e99f-4424-aed5-8f9a405dd8b3 tempest-VolumesSnapshotsTestJSON-1882007277 tempest-VolumesSnapshotsTestJSON-1882007277-project] Returning 404 to user: Snapshot eeefddb5-a5e5-43d4-9f4d-6de4273cd891 could not be found. {{(pid=118332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:25:44.735103 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-92ecd146-e99f-4424-aed5-8f9a405dd8b3 tempest-VolumesSnapshotsTestJSON-1882007277 tempest-VolumesSnapshotsTestJSON-1882007277-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/eeefddb5-a5e5-43d4-9f4d-6de4273cd891" status: 404 len: 111 microversion: 2.1 time: 0.033878 Aug 03 05:25:44.736152 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 545/1118] 10.222.0.40 () {58 vars in 1251 bytes} [Wed Aug 3 05:25:44 2022] GET /compute/v2.1/os-snapshots/eeefddb5-a5e5-43d4-9f4d-6de4273cd891 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:25:44.737954 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-c69ff08b-1f06-456d-a3ac-553da680c51d tempest-VolumesSnapshotsTestJSON-1882007277 tempest-VolumesSnapshotsTestJSON-1882007277-project] Calling method '.version_select at 0x7f7601c88f70>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:25:44.868556 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-dc7094a6-5414-47cc-adfe-3dfc423b5dcf tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3954ab39014ef3819111a6fe8142b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c986ef0f5ea46f9b5e788aaca042b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:25:44.876119 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-dc7094a6-5414-47cc-adfe-3dfc423b5dcf tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/adbab481-7f3a-4430-be8a-4429a6e46b4f" status: 200 len: 1266 microversion: 2.1 time: 0.163008 Aug 03 05:25:44.876725 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 574/1119] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:25:44 2022] GET /compute/v2.1/servers/adbab481-7f3a-4430-be8a-4429a6e46b4f => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:25:44.912933 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-c69ff08b-1f06-456d-a3ac-553da680c51d tempest-VolumesSnapshotsTestJSON-1882007277 tempest-VolumesSnapshotsTestJSON-1882007277-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/5b2c88e8-80be-4043-ac35-be2a438dcccd" status: 202 len: 0 microversion: 2.1 time: 0.179108 Aug 03 05:25:44.913540 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 546/1120] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Aug 3 05:25:44 2022] DELETE /compute/v2.1/os-volumes/5b2c88e8-80be-4043-ac35-be2a438dcccd => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 05:25:44.921807 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-1a38eb89-e31c-4991-b872-0f9d47472225 tempest-VolumesSnapshotsTestJSON-1882007277 tempest-VolumesSnapshotsTestJSON-1882007277-project] Calling method '.version_select at 0x7f760283bca0>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:25:44.968883 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-1a38eb89-e31c-4991-b872-0f9d47472225 tempest-VolumesSnapshotsTestJSON-1882007277 tempest-VolumesSnapshotsTestJSON-1882007277-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/5b2c88e8-80be-4043-ac35-be2a438dcccd" status: 200 len: 345 microversion: 2.1 time: 0.051030 Aug 03 05:25:44.969453 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 575/1121] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Aug 3 05:25:44 2022] GET /compute/v2.1/os-volumes/5b2c88e8-80be-4043-ac35-be2a438dcccd => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:25:45.335005 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [req-8ad4bf78-e169-4c59-8b4f-52cc96983fbd req-742d8bd7-87f2-4fac-b828-59b91ba0ab45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adbab481-7f3a-4430-be8a-4429a6e46b4f", "name": "network-vif-plugged", "status": "completed", "tag": "747aa0a4-d518-4bbd-9bd6-84fef957148e"}]} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:25:45.339995 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:25:45.345210 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-8ad4bf78-e169-4c59-8b4f-52cc96983fbd req-742d8bd7-87f2-4fac-b828-59b91ba0ab45 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:45.345956 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [req-8ad4bf78-e169-4c59-8b4f-52cc96983fbd req-742d8bd7-87f2-4fac-b828-59b91ba0ab45 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:45.349893 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:25:45.357140 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.compute.server_external_events [req-8ad4bf78-e169-4c59-8b4f-52cc96983fbd req-742d8bd7-87f2-4fac-b828-59b91ba0ab45 service nova] Creating event network-vif-plugged:747aa0a4-d518-4bbd-9bd6-84fef957148e for instance adbab481-7f3a-4430-be8a-4429a6e46b4f on hv-cinder-85127 Aug 03 05:25:45.362453 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [req-8ad4bf78-e169-4c59-8b4f-52cc96983fbd req-742d8bd7-87f2-4fac-b828-59b91ba0ab45 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031570 Aug 03 05:25:45.363060 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 547/1122] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:25:45.899072 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-d4989079-8926-4f68-94d1-5eef9f675f90 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:25:45.899624 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-d4989079-8926-4f68-94d1-5eef9f675f90 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: adbab481-7f3a-4430-be8a-4429a6e46b4f] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:25:45.908148 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d4989079-8926-4f68-94d1-5eef9f675f90 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:45.908607 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d4989079-8926-4f68-94d1-5eef9f675f90 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:45.909397 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d4989079-8926-4f68-94d1-5eef9f675f90 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:45.909844 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d4989079-8926-4f68-94d1-5eef9f675f90 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:45.983699 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-951d0052-eb77-489a-b2dd-fafe0def682b tempest-VolumesSnapshotsTestJSON-1882007277 tempest-VolumesSnapshotsTestJSON-1882007277-project] Calling method '.version_select at 0x7f7601e739d0>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:25:46.013687 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.wsgi [None req-951d0052-eb77-489a-b2dd-fafe0def682b tempest-VolumesSnapshotsTestJSON-1882007277 tempest-VolumesSnapshotsTestJSON-1882007277-project] HTTP exception thrown: Volume 5b2c88e8-80be-4043-ac35-be2a438dcccd could not be found. Aug 03 05:25:46.016129 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-951d0052-eb77-489a-b2dd-fafe0def682b tempest-VolumesSnapshotsTestJSON-1882007277 tempest-VolumesSnapshotsTestJSON-1882007277-project] Request method failure captured: Aug 03 05:25:46.016129 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: request: GET /compute/v2.1/os-volumes/5b2c88e8-80be-4043-ac35-be2a438dcccd HTTP/1.1 Aug 03 05:25:46.016129 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Accept: application/json Aug 03 05:25:46.016129 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Accept-Encoding: identity Aug 03 05:25:46.016129 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Connection: close Aug 03 05:25:46.016129 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Content-Length: 0 Aug 03 05:25:46.016129 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Content-Type: application/json Aug 03 05:25:46.016129 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Host: 10.222.0.40 Aug 03 05:25:46.016129 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Openstack-System-Scope: None Aug 03 05:25:46.016129 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: User-Agent: python-urllib3/1.26.10 Aug 03 05:25:46.016129 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Auth-Token: gAAAAABi6gbRX16yF9iOgfxmdYgNhFB0bUPGaPDqvY1ZRXzwHDWw1lYGd6nv7e5GzrMSE8zFRIS54i9zXbq_M7SemaAon4hlKY3S9fN_z2u3a1lX7fxUgEdxY1aU-9VPiziw8IgGzds-LHE04opHr3RFFF5IfJYPY1RyAzUUI944CRW8nqUr7Ig Aug 03 05:25:46.016129 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Domain-Id: None Aug 03 05:25:46.016129 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Domain-Name: None Aug 03 05:25:46.016129 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Identity-Status: Confirmed Aug 03 05:25:46.016129 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Is-Admin-Project: True Aug 03 05:25:46.016129 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Domain-Id: default Aug 03 05:25:46.016129 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Domain-Name: Default Aug 03 05:25:46.016129 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Id: 4af419fadcee40c98ef886109624a631 Aug 03 05:25:46.016129 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1882007277 Aug 03 05:25:46.016129 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Role: member,reader Aug 03 05:25:46.016129 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Roles: member,reader Aug 03 05:25:46.017689 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4af419fadcee40c98ef886109624a631"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4af419fadcee40c98ef886109624a631"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4af419fadcee40c98ef886109624a631"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4af419fadcee40c98ef886109624a631"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:25:46.017689 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1882007277 Aug 03 05:25:46.017689 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant-Id: 4af419fadcee40c98ef886109624a631 Aug 03 05:25:46.017689 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1882007277 Aug 03 05:25:46.017689 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User: tempest-VolumesSnapshotsTestJSON-1882007277-project Aug 03 05:25:46.017689 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Domain-Id: default Aug 03 05:25:46.017689 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Domain-Name: Default Aug 03 05:25:46.017689 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Id: 4de01cf3881741068c9ca8061696ed2a Aug 03 05:25:46.017689 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1882007277-project Aug 03 05:25:46.017689 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: method: Aug 03 05:25:46.017689 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: exception: Volume 5b2c88e8-80be-4043-ac35-be2a438dcccd could not be found. Aug 03 05:25:46.017689 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: action_args: {'id': '5b2c88e8-80be-4043-ac35-be2a438dcccd'} Aug 03 05:25:46.017689 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:25:46.023819 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:25:46.023819 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 05:25:46.023819 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 05:25:46.023819 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 05:25:46.023819 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 05:25:46.023819 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 05:25:46.023819 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 05:25:46.023819 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 05:25:46.023819 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 05:25:46.023819 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 05:25:46.023819 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 05:25:46.023819 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 05:25:46.023819 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 05:25:46.023819 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 05:25:46.023819 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 05:25:46.023819 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5b2c88e8-80be-4043-ac35-be2a438dcccd could not be found. (HTTP 404) (Request-ID: req-a2499c40-3a5d-4368-a18f-0bf140114c9b) Aug 03 05:25:46.023819 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:46.023819 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:25:46.023819 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:46.025181 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:25:46.025181 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 03 05:25:46.025181 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 03 05:25:46.025181 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 05:25:46.025181 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 05:25:46.025181 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 05:25:46.025181 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 05:25:46.025181 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 05:25:46.025181 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 05:25:46.025181 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 05:25:46.025181 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 05:25:46.025181 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 05:25:46.025181 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 05:25:46.025181 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 05:25:46.025181 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 05:25:46.025181 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 05:25:46.025181 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 05:25:46.025181 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 05:25:46.025181 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 05:25:46.026464 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 05:25:46.026464 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 05:25:46.026464 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 05:25:46.026464 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 05:25:46.026464 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5b2c88e8-80be-4043-ac35-be2a438dcccd could not be found. Aug 03 05:25:46.026464 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:46.026464 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:25:46.026464 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:46.026464 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:25:46.026464 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:25:46.026464 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:25:46.026464 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:25:46.026464 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:25:46.026464 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 05:25:46.026464 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 05:25:46.026464 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:25:46.026464 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:25:46.026464 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 03 05:25:46.026464 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:25:46.027889 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5b2c88e8-80be-4043-ac35-be2a438dcccd could not be found. Aug 03 05:25:46.027889 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:46.027889 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:25:46.027889 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:46.027889 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:25:46.027889 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:25:46.027889 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:25:46.027889 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:25:46.027889 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:25:46.027889 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5b2c88e8-80be-4043-ac35-be2a438dcccd could not be found. Aug 03 05:25:46.027889 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:46.027889 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-951d0052-eb77-489a-b2dd-fafe0def682b tempest-VolumesSnapshotsTestJSON-1882007277 tempest-VolumesSnapshotsTestJSON-1882007277-project] Returning 404 to user: Volume 5b2c88e8-80be-4043-ac35-be2a438dcccd could not be found. {{(pid=118332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:25:46.027889 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-951d0052-eb77-489a-b2dd-fafe0def682b tempest-VolumesSnapshotsTestJSON-1882007277 tempest-VolumesSnapshotsTestJSON-1882007277-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/5b2c88e8-80be-4043-ac35-be2a438dcccd" status: 404 len: 109 microversion: 2.1 time: 0.038283 Aug 03 05:25:46.027889 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 548/1123] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Aug 3 05:25:45 2022] GET /compute/v2.1/os-volumes/5b2c88e8-80be-4043-ac35-be2a438dcccd => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 05:25:46.028968 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-555d7647-57e4-4d38-b9e7-d23b2882fdcb tempest-VolumesSnapshotsTestJSON-1882007277 tempest-VolumesSnapshotsTestJSON-1882007277-project] Calling method '.version_select at 0x7f7601eb29d0>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:25:46.052558 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-d4989079-8926-4f68-94d1-5eef9f675f90 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3954ab39014ef3819111a6fe8142b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c986ef0f5ea46f9b5e788aaca042b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:25:46.056045 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.wsgi [None req-555d7647-57e4-4d38-b9e7-d23b2882fdcb tempest-VolumesSnapshotsTestJSON-1882007277 tempest-VolumesSnapshotsTestJSON-1882007277-project] HTTP exception thrown: Volume 5b2c88e8-80be-4043-ac35-be2a438dcccd could not be found. Aug 03 05:25:46.058028 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-555d7647-57e4-4d38-b9e7-d23b2882fdcb tempest-VolumesSnapshotsTestJSON-1882007277 tempest-VolumesSnapshotsTestJSON-1882007277-project] Request method failure captured: Aug 03 05:25:46.058028 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: request: DELETE /compute/v2.1/os-volumes/5b2c88e8-80be-4043-ac35-be2a438dcccd HTTP/1.1 Aug 03 05:25:46.058028 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Accept: application/json Aug 03 05:25:46.058028 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Accept-Encoding: identity Aug 03 05:25:46.058028 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Connection: close Aug 03 05:25:46.058028 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Content-Length: 0 Aug 03 05:25:46.058028 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Content-Type: application/json Aug 03 05:25:46.058028 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Host: 10.222.0.40 Aug 03 05:25:46.058028 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Openstack-System-Scope: None Aug 03 05:25:46.058028 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: User-Agent: python-urllib3/1.26.10 Aug 03 05:25:46.058028 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Auth-Token: gAAAAABi6gbRX16yF9iOgfxmdYgNhFB0bUPGaPDqvY1ZRXzwHDWw1lYGd6nv7e5GzrMSE8zFRIS54i9zXbq_M7SemaAon4hlKY3S9fN_z2u3a1lX7fxUgEdxY1aU-9VPiziw8IgGzds-LHE04opHr3RFFF5IfJYPY1RyAzUUI944CRW8nqUr7Ig Aug 03 05:25:46.058028 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Domain-Id: None Aug 03 05:25:46.058028 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Domain-Name: None Aug 03 05:25:46.058028 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Identity-Status: Confirmed Aug 03 05:25:46.058028 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Is-Admin-Project: True Aug 03 05:25:46.058028 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Domain-Id: default Aug 03 05:25:46.058028 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Domain-Name: Default Aug 03 05:25:46.058028 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Id: 4af419fadcee40c98ef886109624a631 Aug 03 05:25:46.058028 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1882007277 Aug 03 05:25:46.058028 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Role: member,reader Aug 03 05:25:46.058028 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Roles: member,reader Aug 03 05:25:46.059628 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4af419fadcee40c98ef886109624a631"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4af419fadcee40c98ef886109624a631"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4af419fadcee40c98ef886109624a631"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4af419fadcee40c98ef886109624a631"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:25:46.059628 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1882007277 Aug 03 05:25:46.059628 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant-Id: 4af419fadcee40c98ef886109624a631 Aug 03 05:25:46.059628 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1882007277 Aug 03 05:25:46.059628 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User: tempest-VolumesSnapshotsTestJSON-1882007277-project Aug 03 05:25:46.059628 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Domain-Id: default Aug 03 05:25:46.059628 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Domain-Name: Default Aug 03 05:25:46.059628 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Id: 4de01cf3881741068c9ca8061696ed2a Aug 03 05:25:46.059628 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1882007277-project Aug 03 05:25:46.059628 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: method: Aug 03 05:25:46.059628 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: exception: Volume 5b2c88e8-80be-4043-ac35-be2a438dcccd could not be found. Aug 03 05:25:46.059628 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: action_args: {'id': '5b2c88e8-80be-4043-ac35-be2a438dcccd'} Aug 03 05:25:46.059628 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:25:46.063520 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:25:46.063520 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 05:25:46.063520 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 05:25:46.063520 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 03 05:25:46.063520 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 03 05:25:46.063520 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 03 05:25:46.063520 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 03 05:25:46.063520 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 03 05:25:46.063520 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 03 05:25:46.063520 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 03 05:25:46.063520 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 03 05:25:46.063520 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 05:25:46.063520 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 05:25:46.063520 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 05:25:46.063520 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 05:25:46.063520 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5b2c88e8-80be-4043-ac35-be2a438dcccd could not be found. (HTTP 404) (Request-ID: req-a402f228-ea95-449f-ad84-468b9ed7c6c3) Aug 03 05:25:46.063520 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:46.063520 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:25:46.063520 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:46.065033 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:25:46.065033 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 03 05:25:46.065033 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 03 05:25:46.065033 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 05:25:46.065033 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 05:25:46.065033 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 05:25:46.065033 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 05:25:46.065033 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 05:25:46.065033 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 05:25:46.065033 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 05:25:46.065033 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 05:25:46.065033 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 03 05:25:46.065033 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 03 05:25:46.065033 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 03 05:25:46.065033 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 03 05:25:46.065033 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 03 05:25:46.065033 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 03 05:25:46.065033 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 03 05:25:46.065033 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 03 05:25:46.066918 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 05:25:46.066918 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 05:25:46.066918 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 05:25:46.066918 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 05:25:46.066918 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5b2c88e8-80be-4043-ac35-be2a438dcccd could not be found. Aug 03 05:25:46.066918 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:46.066918 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:25:46.066918 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:46.066918 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:25:46.066918 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:25:46.066918 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:25:46.066918 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:25:46.066918 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:25:46.066918 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 05:25:46.066918 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 05:25:46.066918 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:25:46.066918 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:25:46.066918 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 03 05:25:46.066918 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:25:46.071119 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5b2c88e8-80be-4043-ac35-be2a438dcccd could not be found. Aug 03 05:25:46.071119 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:46.071119 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:25:46.071119 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:46.071119 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:25:46.071119 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:25:46.071119 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:25:46.071119 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:25:46.071119 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:25:46.071119 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5b2c88e8-80be-4043-ac35-be2a438dcccd could not be found. Aug 03 05:25:46.071119 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:46.071119 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-555d7647-57e4-4d38-b9e7-d23b2882fdcb tempest-VolumesSnapshotsTestJSON-1882007277 tempest-VolumesSnapshotsTestJSON-1882007277-project] Returning 404 to user: Volume 5b2c88e8-80be-4043-ac35-be2a438dcccd could not be found. {{(pid=118332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:25:46.071119 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-555d7647-57e4-4d38-b9e7-d23b2882fdcb tempest-VolumesSnapshotsTestJSON-1882007277 tempest-VolumesSnapshotsTestJSON-1882007277-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/5b2c88e8-80be-4043-ac35-be2a438dcccd" status: 404 len: 109 microversion: 2.1 time: 0.035312 Aug 03 05:25:46.072119 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 549/1124] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Aug 3 05:25:46 2022] DELETE /compute/v2.1/os-volumes/5b2c88e8-80be-4043-ac35-be2a438dcccd => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 05:25:46.072213 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-d4989079-8926-4f68-94d1-5eef9f675f90 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/adbab481-7f3a-4430-be8a-4429a6e46b4f" status: 200 len: 1266 microversion: 2.1 time: 0.167046 Aug 03 05:25:46.072213 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 576/1125] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:25:45 2022] GET /compute/v2.1/servers/adbab481-7f3a-4430-be8a-4429a6e46b4f => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:25:46.072791 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-36078499-49ca-4916-b890-2f5d9bd41ac9 tempest-VolumesSnapshotsTestJSON-1882007277 tempest-VolumesSnapshotsTestJSON-1882007277-project] Calling method '.version_select at 0x7f7601d65e50>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:25:46.100969 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.wsgi [None req-36078499-49ca-4916-b890-2f5d9bd41ac9 tempest-VolumesSnapshotsTestJSON-1882007277 tempest-VolumesSnapshotsTestJSON-1882007277-project] HTTP exception thrown: Volume 5b2c88e8-80be-4043-ac35-be2a438dcccd could not be found. Aug 03 05:25:46.102943 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-36078499-49ca-4916-b890-2f5d9bd41ac9 tempest-VolumesSnapshotsTestJSON-1882007277 tempest-VolumesSnapshotsTestJSON-1882007277-project] Request method failure captured: Aug 03 05:25:46.102943 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: request: GET /compute/v2.1/os-volumes/5b2c88e8-80be-4043-ac35-be2a438dcccd HTTP/1.1 Aug 03 05:25:46.102943 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Accept: application/json Aug 03 05:25:46.102943 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Accept-Encoding: identity Aug 03 05:25:46.102943 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Connection: close Aug 03 05:25:46.102943 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Content-Length: 0 Aug 03 05:25:46.102943 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Content-Type: application/json Aug 03 05:25:46.102943 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Host: 10.222.0.40 Aug 03 05:25:46.102943 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Openstack-System-Scope: None Aug 03 05:25:46.102943 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: User-Agent: python-urllib3/1.26.10 Aug 03 05:25:46.102943 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Auth-Token: gAAAAABi6gbRX16yF9iOgfxmdYgNhFB0bUPGaPDqvY1ZRXzwHDWw1lYGd6nv7e5GzrMSE8zFRIS54i9zXbq_M7SemaAon4hlKY3S9fN_z2u3a1lX7fxUgEdxY1aU-9VPiziw8IgGzds-LHE04opHr3RFFF5IfJYPY1RyAzUUI944CRW8nqUr7Ig Aug 03 05:25:46.102943 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Domain-Id: None Aug 03 05:25:46.102943 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Domain-Name: None Aug 03 05:25:46.102943 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Identity-Status: Confirmed Aug 03 05:25:46.102943 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Is-Admin-Project: True Aug 03 05:25:46.102943 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Domain-Id: default Aug 03 05:25:46.102943 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Domain-Name: Default Aug 03 05:25:46.102943 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Id: 4af419fadcee40c98ef886109624a631 Aug 03 05:25:46.102943 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1882007277 Aug 03 05:25:46.102943 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Role: member,reader Aug 03 05:25:46.102943 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Roles: member,reader Aug 03 05:25:46.104616 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4af419fadcee40c98ef886109624a631"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4af419fadcee40c98ef886109624a631"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4af419fadcee40c98ef886109624a631"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4af419fadcee40c98ef886109624a631"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:25:46.104616 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1882007277 Aug 03 05:25:46.104616 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant-Id: 4af419fadcee40c98ef886109624a631 Aug 03 05:25:46.104616 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1882007277 Aug 03 05:25:46.104616 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User: tempest-VolumesSnapshotsTestJSON-1882007277-project Aug 03 05:25:46.104616 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Domain-Id: default Aug 03 05:25:46.104616 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Domain-Name: Default Aug 03 05:25:46.104616 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Id: 4de01cf3881741068c9ca8061696ed2a Aug 03 05:25:46.104616 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1882007277-project Aug 03 05:25:46.104616 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: method: Aug 03 05:25:46.104616 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: exception: Volume 5b2c88e8-80be-4043-ac35-be2a438dcccd could not be found. Aug 03 05:25:46.104616 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: action_args: {'id': '5b2c88e8-80be-4043-ac35-be2a438dcccd'} Aug 03 05:25:46.104616 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:25:46.105656 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:25:46.105656 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 05:25:46.105656 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 05:25:46.105656 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 05:25:46.105656 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 05:25:46.105656 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 05:25:46.105656 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 05:25:46.105656 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 05:25:46.105656 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 05:25:46.105656 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 05:25:46.105656 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 05:25:46.105656 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 05:25:46.105656 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 05:25:46.105656 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 05:25:46.105656 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 05:25:46.105656 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5b2c88e8-80be-4043-ac35-be2a438dcccd could not be found. (HTTP 404) (Request-ID: req-ead6e6fe-8548-43a4-8938-e226ffe64063) Aug 03 05:25:46.105656 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:46.105656 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:25:46.105656 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:46.107101 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:25:46.107101 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 03 05:25:46.107101 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 03 05:25:46.107101 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 05:25:46.107101 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 05:25:46.107101 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 05:25:46.107101 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 05:25:46.107101 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 05:25:46.107101 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 05:25:46.107101 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 05:25:46.107101 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 05:25:46.107101 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 05:25:46.107101 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 05:25:46.107101 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 05:25:46.107101 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 05:25:46.107101 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 05:25:46.107101 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 05:25:46.107101 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 05:25:46.107101 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 05:25:46.108586 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 05:25:46.108586 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 05:25:46.108586 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 05:25:46.108586 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 05:25:46.108586 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5b2c88e8-80be-4043-ac35-be2a438dcccd could not be found. Aug 03 05:25:46.108586 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:46.108586 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:25:46.108586 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:46.108586 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:25:46.108586 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:25:46.108586 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:25:46.108586 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:25:46.108586 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:25:46.108586 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 05:25:46.108586 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 05:25:46.108586 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:25:46.108586 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:25:46.108586 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 03 05:25:46.108586 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:25:46.110002 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5b2c88e8-80be-4043-ac35-be2a438dcccd could not be found. Aug 03 05:25:46.110002 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:46.110002 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:25:46.110002 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:46.110002 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:25:46.110002 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:25:46.110002 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:25:46.110002 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:25:46.110002 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:25:46.110002 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5b2c88e8-80be-4043-ac35-be2a438dcccd could not be found. Aug 03 05:25:46.110002 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:46.110002 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-36078499-49ca-4916-b890-2f5d9bd41ac9 tempest-VolumesSnapshotsTestJSON-1882007277 tempest-VolumesSnapshotsTestJSON-1882007277-project] Returning 404 to user: Volume 5b2c88e8-80be-4043-ac35-be2a438dcccd could not be found. {{(pid=118332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:25:46.110002 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-36078499-49ca-4916-b890-2f5d9bd41ac9 tempest-VolumesSnapshotsTestJSON-1882007277 tempest-VolumesSnapshotsTestJSON-1882007277-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/5b2c88e8-80be-4043-ac35-be2a438dcccd" status: 404 len: 109 microversion: 2.1 time: 0.035222 Aug 03 05:25:46.110002 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 550/1126] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Aug 3 05:25:46 2022] GET /compute/v2.1/os-volumes/5b2c88e8-80be-4043-ac35-be2a438dcccd => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 05:25:47.082457 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-8366a8bb-19ee-47d4-ab51-0ae6cc37b837 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:25:47.083877 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-8366a8bb-19ee-47d4-ab51-0ae6cc37b837 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: adbab481-7f3a-4430-be8a-4429a6e46b4f] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:25:47.090623 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8366a8bb-19ee-47d4-ab51-0ae6cc37b837 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:47.091118 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8366a8bb-19ee-47d4-ab51-0ae6cc37b837 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:47.095018 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8366a8bb-19ee-47d4-ab51-0ae6cc37b837 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:47.095018 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8366a8bb-19ee-47d4-ab51-0ae6cc37b837 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:47.231259 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-8366a8bb-19ee-47d4-ab51-0ae6cc37b837 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3954ab39014ef3819111a6fe8142b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c986ef0f5ea46f9b5e788aaca042b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:25:47.238928 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-8366a8bb-19ee-47d4-ab51-0ae6cc37b837 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/adbab481-7f3a-4430-be8a-4429a6e46b4f" status: 200 len: 1453 microversion: 2.1 time: 0.160854 Aug 03 05:25:47.239627 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 577/1127] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:25:47 2022] GET /compute/v2.1/servers/adbab481-7f3a-4430-be8a-4429a6e46b4f => generated 1453 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:25:47.261092 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-e9bae675-8c3b-4765-86b4-42014b77e855 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:25:47.261865 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-e9bae675-8c3b-4765-86b4-42014b77e855 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: adbab481-7f3a-4430-be8a-4429a6e46b4f] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:25:47.268532 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e9bae675-8c3b-4765-86b4-42014b77e855 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:47.268917 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e9bae675-8c3b-4765-86b4-42014b77e855 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:47.269888 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e9bae675-8c3b-4765-86b4-42014b77e855 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:47.270337 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-e9bae675-8c3b-4765-86b4-42014b77e855 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:47.409188 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-e9bae675-8c3b-4765-86b4-42014b77e855 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3954ab39014ef3819111a6fe8142b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c986ef0f5ea46f9b5e788aaca042b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:25:47.416763 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-e9bae675-8c3b-4765-86b4-42014b77e855 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/adbab481-7f3a-4430-be8a-4429a6e46b4f" status: 200 len: 1453 microversion: 2.1 time: 0.161625 Aug 03 05:25:47.417359 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 551/1128] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:25:47 2022] GET /compute/v2.1/servers/adbab481-7f3a-4430-be8a-4429a6e46b4f => generated 1453 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:25:48.038466 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-7ec99e36-fe3a-45d9-807e-ab8282446407 tempest-VolumesNegativeTest-176959654 tempest-VolumesNegativeTest-176959654-project] Action: 'create', calling method: .version_select at 0x7f760283bca0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-177886004", "metadata": {"Type": "work"}}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:25:48.055538 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-7ec99e36-fe3a-45d9-807e-ab8282446407 tempest-VolumesNegativeTest-176959654 tempest-VolumesNegativeTest-176959654-project] Request method failure captured: Aug 03 05:25:48.055538 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 03 05:25:48.055538 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Accept: application/json Aug 03 05:25:48.055538 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Accept-Encoding: identity Aug 03 05:25:48.055538 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Connection: close Aug 03 05:25:48.055538 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Content-Length: 121 Aug 03 05:25:48.055538 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Content-Type: application/json Aug 03 05:25:48.055538 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Host: 10.222.0.40 Aug 03 05:25:48.055538 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Openstack-System-Scope: None Aug 03 05:25:48.055538 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: User-Agent: python-urllib3/1.26.10 Aug 03 05:25:48.055538 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Auth-Token: gAAAAABi6gbbeSSci7J7LG4yHY4ULXwgj5AgoxjzCFGnHAIqI9554tbFsLADVd0zmsBZconHLXtOp4MfHBBpaTAxXvlk0AiG3ZhQGeZDpsjQyQJ9c4enjPPJxKkLFGYlvgI4kSJ0tfK99i_StVw13HtzUSbG9L-xP4bPjmhAFm0gSRPNZO4V8sg Aug 03 05:25:48.055538 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Domain-Id: None Aug 03 05:25:48.055538 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Domain-Name: None Aug 03 05:25:48.055538 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Identity-Status: Confirmed Aug 03 05:25:48.055538 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Is-Admin-Project: True Aug 03 05:25:48.055538 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Domain-Id: default Aug 03 05:25:48.055538 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Domain-Name: Default Aug 03 05:25:48.055538 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Id: 1368716392674f62bd5b38d607455955 Aug 03 05:25:48.055538 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Name: tempest-VolumesNegativeTest-176959654 Aug 03 05:25:48.055538 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Role: member,reader Aug 03 05:25:48.055538 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Roles: member,reader Aug 03 05:25:48.057215 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1368716392674f62bd5b38d607455955"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1368716392674f62bd5b38d607455955"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1368716392674f62bd5b38d607455955"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1368716392674f62bd5b38d607455955"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:25:48.057215 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant: tempest-VolumesNegativeTest-176959654 Aug 03 05:25:48.057215 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant-Id: 1368716392674f62bd5b38d607455955 Aug 03 05:25:48.057215 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant-Name: tempest-VolumesNegativeTest-176959654 Aug 03 05:25:48.057215 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User: tempest-VolumesNegativeTest-176959654-project Aug 03 05:25:48.057215 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Domain-Id: default Aug 03 05:25:48.057215 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Domain-Name: Default Aug 03 05:25:48.057215 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Id: 54c34855b8cc48fb9fc5febf917330a1 Aug 03 05:25:48.057215 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Name: tempest-VolumesNegativeTest-176959654-project Aug 03 05:25:48.057215 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Aug 03 05:25:48.057215 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-177886004", "metadata": {"Type": "work"}}} Aug 03 05:25:48.057215 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: method: Aug 03 05:25:48.057215 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 03 05:25:48.058243 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-177886004', 'metadata': {'Type': 'work'}}}} Aug 03 05:25:48.058243 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:25:48.058243 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:25:48.058243 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 05:25:48.058243 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 05:25:48.058243 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 05:25:48.058243 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise error Aug 03 05:25:48.058243 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 03 05:25:48.058243 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:25:48.058243 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 03 05:25:48.058243 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 03 05:25:48.058243 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:25:48.058243 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 03 05:25:48.058243 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi '#$%' Aug 03 05:25:48.058243 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:25:48.058243 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:25:48.058243 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:25:48.058243 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:25:48.058243 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:25:48.058243 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:25:48.058243 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:25:48.058243 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:25:48.060066 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 05:25:48.060066 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 05:25:48.060066 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:25:48.060066 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:25:48.060066 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 05:25:48.060066 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 05:25:48.060066 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 05:25:48.060066 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 05:25:48.060066 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 05:25:48.060066 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 05:25:48.060066 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 03 05:25:48.060066 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:25:48.060066 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:25:48.060066 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:25:48.060066 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:25:48.060066 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:25:48.060066 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:25:48.060066 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 05:25:48.060066 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 05:25:48.061380 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 03 05:25:48.061380 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:25:48.061380 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-7ec99e36-fe3a-45d9-807e-ab8282446407 tempest-VolumesNegativeTest-176959654 tempest-VolumesNegativeTest-176959654-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:25:48.061380 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-7ec99e36-fe3a-45d9-807e-ab8282446407 tempest-VolumesNegativeTest-176959654 tempest-VolumesNegativeTest-176959654-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.137880 Aug 03 05:25:48.061380 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 578/1129] 10.222.0.40 () {60 vars in 1156 bytes} [Wed Aug 3 05:25:47 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 139 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 05:25:48.068116 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-1abb79b9-7a3d-4019-aff1-fa784d040306 tempest-VolumesNegativeTest-176959654 tempest-VolumesNegativeTest-176959654-project] Action: 'create', calling method: .version_select at 0x7f7601eb2af0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2009980944", "metadata": {"Type": "work"}}} {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:25:48.072980 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-1abb79b9-7a3d-4019-aff1-fa784d040306 tempest-VolumesNegativeTest-176959654 tempest-VolumesNegativeTest-176959654-project] Request method failure captured: Aug 03 05:25:48.072980 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 03 05:25:48.072980 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Accept: application/json Aug 03 05:25:48.072980 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Accept-Encoding: identity Aug 03 05:25:48.072980 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Connection: close Aug 03 05:25:48.072980 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Content-Length: 120 Aug 03 05:25:48.072980 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Content-Type: application/json Aug 03 05:25:48.072980 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Host: 10.222.0.40 Aug 03 05:25:48.072980 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Openstack-System-Scope: None Aug 03 05:25:48.072980 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: User-Agent: python-urllib3/1.26.10 Aug 03 05:25:48.072980 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Auth-Token: gAAAAABi6gbbeSSci7J7LG4yHY4ULXwgj5AgoxjzCFGnHAIqI9554tbFsLADVd0zmsBZconHLXtOp4MfHBBpaTAxXvlk0AiG3ZhQGeZDpsjQyQJ9c4enjPPJxKkLFGYlvgI4kSJ0tfK99i_StVw13HtzUSbG9L-xP4bPjmhAFm0gSRPNZO4V8sg Aug 03 05:25:48.072980 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Domain-Id: None Aug 03 05:25:48.072980 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Domain-Name: None Aug 03 05:25:48.072980 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Identity-Status: Confirmed Aug 03 05:25:48.072980 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Is-Admin-Project: True Aug 03 05:25:48.072980 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Domain-Id: default Aug 03 05:25:48.072980 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Domain-Name: Default Aug 03 05:25:48.072980 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Id: 1368716392674f62bd5b38d607455955 Aug 03 05:25:48.072980 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Name: tempest-VolumesNegativeTest-176959654 Aug 03 05:25:48.072980 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Role: member,reader Aug 03 05:25:48.072980 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Roles: member,reader Aug 03 05:25:48.074503 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1368716392674f62bd5b38d607455955"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1368716392674f62bd5b38d607455955"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1368716392674f62bd5b38d607455955"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1368716392674f62bd5b38d607455955"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:25:48.074503 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant: tempest-VolumesNegativeTest-176959654 Aug 03 05:25:48.074503 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant-Id: 1368716392674f62bd5b38d607455955 Aug 03 05:25:48.074503 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant-Name: tempest-VolumesNegativeTest-176959654 Aug 03 05:25:48.074503 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User: tempest-VolumesNegativeTest-176959654-project Aug 03 05:25:48.074503 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Domain-Id: default Aug 03 05:25:48.074503 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Domain-Name: Default Aug 03 05:25:48.074503 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Id: 54c34855b8cc48fb9fc5febf917330a1 Aug 03 05:25:48.074503 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Name: tempest-VolumesNegativeTest-176959654-project Aug 03 05:25:48.074503 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Aug 03 05:25:48.074503 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2009980944", "metadata": {"Type": "work"}}} Aug 03 05:25:48.074503 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: method: Aug 03 05:25:48.074503 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 03 05:25:48.075391 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2009980944', 'metadata': {'Type': 'work'}}}} Aug 03 05:25:48.075391 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:25:48.075391 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:25:48.075391 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 05:25:48.075391 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 05:25:48.075391 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 05:25:48.075391 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise error Aug 03 05:25:48.075391 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 03 05:25:48.075391 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:48.075391 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 03 05:25:48.075391 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 03 05:25:48.075391 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:48.075391 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 03 05:25:48.075391 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi '0' Aug 03 05:25:48.075391 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:48.075391 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:25:48.075391 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:48.075391 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:25:48.075391 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:25:48.075391 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:25:48.075391 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:25:48.075391 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:25:48.076826 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 05:25:48.076826 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 05:25:48.076826 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:25:48.076826 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:25:48.076826 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 05:25:48.076826 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 05:25:48.076826 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 05:25:48.076826 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 05:25:48.076826 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 05:25:48.076826 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 05:25:48.076826 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 03 05:25:48.076826 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:48.076826 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:25:48.076826 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:48.076826 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:25:48.076826 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:25:48.076826 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:25:48.076826 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 05:25:48.076826 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 05:25:48.078222 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 03 05:25:48.078222 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:48.079270 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-1abb79b9-7a3d-4019-aff1-fa784d040306 tempest-VolumesNegativeTest-176959654 tempest-VolumesNegativeTest-176959654-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:25:48.080269 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-1abb79b9-7a3d-4019-aff1-fa784d040306 tempest-VolumesNegativeTest-176959654 tempest-VolumesNegativeTest-176959654-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.017035 Aug 03 05:25:48.080835 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 552/1130] 10.222.0.40 () {60 vars in 1156 bytes} [Wed Aug 3 05:25:48 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 05:25:48.090588 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-86b55223-e05b-4719-a4d8-9d5e544947ca tempest-VolumesNegativeTest-176959654 tempest-VolumesNegativeTest-176959654-project] Action: 'create', calling method: .version_select at 0x7f760285cc10>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1804571960", "metadata": {"Type": "work"}}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:25:48.095020 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-86b55223-e05b-4719-a4d8-9d5e544947ca tempest-VolumesNegativeTest-176959654 tempest-VolumesNegativeTest-176959654-project] Request method failure captured: Aug 03 05:25:48.095020 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 03 05:25:48.095020 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Accept: application/json Aug 03 05:25:48.095020 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Accept-Encoding: identity Aug 03 05:25:48.095020 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Connection: close Aug 03 05:25:48.095020 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Content-Length: 119 Aug 03 05:25:48.095020 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Content-Type: application/json Aug 03 05:25:48.095020 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Host: 10.222.0.40 Aug 03 05:25:48.095020 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Openstack-System-Scope: None Aug 03 05:25:48.095020 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: User-Agent: python-urllib3/1.26.10 Aug 03 05:25:48.095020 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Auth-Token: gAAAAABi6gbbeSSci7J7LG4yHY4ULXwgj5AgoxjzCFGnHAIqI9554tbFsLADVd0zmsBZconHLXtOp4MfHBBpaTAxXvlk0AiG3ZhQGeZDpsjQyQJ9c4enjPPJxKkLFGYlvgI4kSJ0tfK99i_StVw13HtzUSbG9L-xP4bPjmhAFm0gSRPNZO4V8sg Aug 03 05:25:48.095020 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Domain-Id: None Aug 03 05:25:48.095020 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Domain-Name: None Aug 03 05:25:48.095020 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Identity-Status: Confirmed Aug 03 05:25:48.095020 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Is-Admin-Project: True Aug 03 05:25:48.095020 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Domain-Id: default Aug 03 05:25:48.095020 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Domain-Name: Default Aug 03 05:25:48.095020 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Id: 1368716392674f62bd5b38d607455955 Aug 03 05:25:48.095020 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Name: tempest-VolumesNegativeTest-176959654 Aug 03 05:25:48.095020 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Role: member,reader Aug 03 05:25:48.095020 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Roles: member,reader Aug 03 05:25:48.096758 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1368716392674f62bd5b38d607455955"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1368716392674f62bd5b38d607455955"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1368716392674f62bd5b38d607455955"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1368716392674f62bd5b38d607455955"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:25:48.096758 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant: tempest-VolumesNegativeTest-176959654 Aug 03 05:25:48.096758 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant-Id: 1368716392674f62bd5b38d607455955 Aug 03 05:25:48.096758 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant-Name: tempest-VolumesNegativeTest-176959654 Aug 03 05:25:48.096758 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User: tempest-VolumesNegativeTest-176959654-project Aug 03 05:25:48.096758 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Domain-Id: default Aug 03 05:25:48.096758 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Domain-Name: Default Aug 03 05:25:48.096758 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Id: 54c34855b8cc48fb9fc5febf917330a1 Aug 03 05:25:48.096758 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Name: tempest-VolumesNegativeTest-176959654-project Aug 03 05:25:48.096758 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Aug 03 05:25:48.096758 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1804571960", "metadata": {"Type": "work"}}} Aug 03 05:25:48.096758 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: method: Aug 03 05:25:48.096758 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 03 05:25:48.097745 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1804571960', 'metadata': {'Type': 'work'}}}} Aug 03 05:25:48.097745 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:25:48.097745 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:25:48.097745 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 05:25:48.097745 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 05:25:48.097745 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 05:25:48.097745 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise error Aug 03 05:25:48.097745 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 03 05:25:48.097745 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:25:48.097745 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 03 05:25:48.097745 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 03 05:25:48.097745 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:25:48.097745 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 03 05:25:48.097745 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi '' Aug 03 05:25:48.097745 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:25:48.097745 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:25:48.097745 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:25:48.097745 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:25:48.097745 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:25:48.097745 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:25:48.097745 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:25:48.097745 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:25:48.099944 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 05:25:48.099944 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 05:25:48.099944 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:25:48.099944 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:25:48.099944 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 05:25:48.099944 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 05:25:48.099944 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 05:25:48.099944 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 05:25:48.099944 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 05:25:48.099944 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 05:25:48.099944 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 03 05:25:48.099944 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:25:48.099944 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:25:48.099944 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:25:48.099944 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:25:48.099944 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:25:48.099944 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:25:48.099944 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 05:25:48.099944 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 05:25:48.101775 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 03 05:25:48.101775 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:25:48.101775 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-86b55223-e05b-4719-a4d8-9d5e544947ca tempest-VolumesNegativeTest-176959654 tempest-VolumesNegativeTest-176959654-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:25:48.101775 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-86b55223-e05b-4719-a4d8-9d5e544947ca tempest-VolumesNegativeTest-176959654 tempest-VolumesNegativeTest-176959654-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010366 Aug 03 05:25:48.101775 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 579/1131] 10.222.0.40 () {60 vars in 1156 bytes} [Wed Aug 3 05:25:48 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 05:25:48.106764 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-389eabcf-068c-4e0f-8fab-dbc940d29cee tempest-VolumesNegativeTest-176959654 tempest-VolumesNegativeTest-176959654-project] Calling method '.version_select at 0x7f7601c88f70>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:25:48.136241 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.wsgi [None req-389eabcf-068c-4e0f-8fab-dbc940d29cee tempest-VolumesNegativeTest-176959654 tempest-VolumesNegativeTest-176959654-project] HTTP exception thrown: Volume tempest-invalid-520494558 could not be found. Aug 03 05:25:48.139249 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-389eabcf-068c-4e0f-8fab-dbc940d29cee tempest-VolumesNegativeTest-176959654 tempest-VolumesNegativeTest-176959654-project] Request method failure captured: Aug 03 05:25:48.139249 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-520494558 HTTP/1.1 Aug 03 05:25:48.139249 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Accept: application/json Aug 03 05:25:48.139249 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Accept-Encoding: identity Aug 03 05:25:48.139249 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Connection: close Aug 03 05:25:48.139249 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Content-Length: 0 Aug 03 05:25:48.139249 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Content-Type: application/json Aug 03 05:25:48.139249 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Host: 10.222.0.40 Aug 03 05:25:48.139249 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Openstack-System-Scope: None Aug 03 05:25:48.139249 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: User-Agent: python-urllib3/1.26.10 Aug 03 05:25:48.139249 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Auth-Token: gAAAAABi6gbbeSSci7J7LG4yHY4ULXwgj5AgoxjzCFGnHAIqI9554tbFsLADVd0zmsBZconHLXtOp4MfHBBpaTAxXvlk0AiG3ZhQGeZDpsjQyQJ9c4enjPPJxKkLFGYlvgI4kSJ0tfK99i_StVw13HtzUSbG9L-xP4bPjmhAFm0gSRPNZO4V8sg Aug 03 05:25:48.139249 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Domain-Id: None Aug 03 05:25:48.139249 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Domain-Name: None Aug 03 05:25:48.139249 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Identity-Status: Confirmed Aug 03 05:25:48.139249 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Is-Admin-Project: True Aug 03 05:25:48.139249 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Domain-Id: default Aug 03 05:25:48.139249 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Domain-Name: Default Aug 03 05:25:48.139249 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Id: 1368716392674f62bd5b38d607455955 Aug 03 05:25:48.139249 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Name: tempest-VolumesNegativeTest-176959654 Aug 03 05:25:48.139249 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Role: member,reader Aug 03 05:25:48.139249 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Roles: member,reader Aug 03 05:25:48.140922 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1368716392674f62bd5b38d607455955"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1368716392674f62bd5b38d607455955"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1368716392674f62bd5b38d607455955"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1368716392674f62bd5b38d607455955"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:25:48.140922 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant: tempest-VolumesNegativeTest-176959654 Aug 03 05:25:48.140922 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant-Id: 1368716392674f62bd5b38d607455955 Aug 03 05:25:48.140922 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant-Name: tempest-VolumesNegativeTest-176959654 Aug 03 05:25:48.140922 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User: tempest-VolumesNegativeTest-176959654-project Aug 03 05:25:48.140922 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Domain-Id: default Aug 03 05:25:48.140922 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Domain-Name: Default Aug 03 05:25:48.140922 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Id: 54c34855b8cc48fb9fc5febf917330a1 Aug 03 05:25:48.140922 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Name: tempest-VolumesNegativeTest-176959654-project Aug 03 05:25:48.140922 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: method: Aug 03 05:25:48.140922 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: exception: Volume tempest-invalid-520494558 could not be found. Aug 03 05:25:48.140922 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: action_args: {'id': 'tempest-invalid-520494558'} Aug 03 05:25:48.140922 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:25:48.141928 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:25:48.141928 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 05:25:48.141928 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 05:25:48.141928 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 03 05:25:48.141928 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 03 05:25:48.141928 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 03 05:25:48.141928 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 03 05:25:48.141928 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 03 05:25:48.141928 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 03 05:25:48.141928 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 03 05:25:48.141928 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 03 05:25:48.141928 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 05:25:48.141928 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 05:25:48.141928 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 05:25:48.141928 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 05:25:48.141928 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-520494558 could not be found. (HTTP 404) (Request-ID: req-3ff862be-068f-4e58-8694-c04a337b6222) Aug 03 05:25:48.141928 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:48.141928 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:25:48.141928 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:48.143415 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:25:48.143415 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 03 05:25:48.143415 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 03 05:25:48.143415 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 05:25:48.143415 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 05:25:48.143415 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 05:25:48.143415 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 05:25:48.143415 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 05:25:48.143415 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 05:25:48.143415 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 05:25:48.143415 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 05:25:48.143415 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 03 05:25:48.143415 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 03 05:25:48.143415 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 03 05:25:48.143415 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 03 05:25:48.143415 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 03 05:25:48.143415 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 03 05:25:48.143415 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 03 05:25:48.143415 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 03 05:25:48.144906 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 05:25:48.144906 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 05:25:48.144906 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 05:25:48.144906 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 05:25:48.144906 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-520494558 could not be found. Aug 03 05:25:48.144906 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:48.144906 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:25:48.144906 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:48.144906 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:25:48.144906 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:25:48.144906 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:25:48.144906 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:25:48.144906 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:25:48.144906 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 05:25:48.144906 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 05:25:48.144906 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:25:48.144906 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:25:48.144906 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 03 05:25:48.144906 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:25:48.144906 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-520494558 could not be found. Aug 03 05:25:48.146396 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:48.146396 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:25:48.146396 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:48.146396 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:25:48.146396 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:25:48.146396 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:25:48.146396 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:25:48.146396 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:25:48.146396 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-520494558 could not be found. Aug 03 05:25:48.146396 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:48.146396 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-389eabcf-068c-4e0f-8fab-dbc940d29cee tempest-VolumesNegativeTest-176959654 tempest-VolumesNegativeTest-176959654-project] Returning 404 to user: Volume tempest-invalid-520494558 could not be found. {{(pid=118332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:25:48.146396 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-389eabcf-068c-4e0f-8fab-dbc940d29cee tempest-VolumesNegativeTest-176959654 tempest-VolumesNegativeTest-176959654-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/tempest-invalid-520494558" status: 404 len: 98 microversion: 2.1 time: 0.038081 Aug 03 05:25:48.146396 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 553/1132] 10.222.0.40 () {58 vars in 1215 bytes} [Wed Aug 3 05:25:48 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-520494558 => generated 98 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 05:25:48.152224 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-9bb88f35-1fdc-4956-8244-633a4a04cf37 tempest-VolumesNegativeTest-176959654 tempest-VolumesNegativeTest-176959654-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003822 Aug 03 05:25:48.152815 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 580/1133] 10.222.0.40 () {58 vars in 1140 bytes} [Wed Aug 3 05:25:48 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 03 05:25:48.167085 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-80980d02-2280-4ba6-9eda-9a330166447b tempest-VolumesNegativeTest-176959654 tempest-VolumesNegativeTest-176959654-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003821 Aug 03 05:25:48.167606 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 554/1134] 10.222.0.40 () {58 vars in 1137 bytes} [Wed Aug 3 05:25:48 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 03 05:25:48.177302 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-f58fdb24-77c0-4bd0-ae53-cbf7cf77227c tempest-VolumesNegativeTest-176959654 tempest-VolumesNegativeTest-176959654-project] Calling method '.version_select at 0x7f7601e36c10>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:25:48.205505 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.wsgi [None req-f58fdb24-77c0-4bd0-ae53-cbf7cf77227c tempest-VolumesNegativeTest-176959654 tempest-VolumesNegativeTest-176959654-project] HTTP exception thrown: Volume 88b1a5ce-fe19-4f2b-b473-5b9233aa62af could not be found. Aug 03 05:25:48.207488 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-f58fdb24-77c0-4bd0-ae53-cbf7cf77227c tempest-VolumesNegativeTest-176959654 tempest-VolumesNegativeTest-176959654-project] Request method failure captured: Aug 03 05:25:48.207488 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: request: DELETE /compute/v2.1/os-volumes/88b1a5ce-fe19-4f2b-b473-5b9233aa62af HTTP/1.1 Aug 03 05:25:48.207488 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Accept: application/json Aug 03 05:25:48.207488 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Accept-Encoding: identity Aug 03 05:25:48.207488 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Connection: close Aug 03 05:25:48.207488 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Content-Length: 0 Aug 03 05:25:48.207488 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Content-Type: application/json Aug 03 05:25:48.207488 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Host: 10.222.0.40 Aug 03 05:25:48.207488 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Openstack-System-Scope: None Aug 03 05:25:48.207488 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: User-Agent: python-urllib3/1.26.10 Aug 03 05:25:48.207488 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Auth-Token: gAAAAABi6gbbeSSci7J7LG4yHY4ULXwgj5AgoxjzCFGnHAIqI9554tbFsLADVd0zmsBZconHLXtOp4MfHBBpaTAxXvlk0AiG3ZhQGeZDpsjQyQJ9c4enjPPJxKkLFGYlvgI4kSJ0tfK99i_StVw13HtzUSbG9L-xP4bPjmhAFm0gSRPNZO4V8sg Aug 03 05:25:48.207488 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Domain-Id: None Aug 03 05:25:48.207488 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Domain-Name: None Aug 03 05:25:48.207488 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Identity-Status: Confirmed Aug 03 05:25:48.207488 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Is-Admin-Project: True Aug 03 05:25:48.207488 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Domain-Id: default Aug 03 05:25:48.207488 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Domain-Name: Default Aug 03 05:25:48.207488 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Id: 1368716392674f62bd5b38d607455955 Aug 03 05:25:48.207488 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Name: tempest-VolumesNegativeTest-176959654 Aug 03 05:25:48.207488 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Role: member,reader Aug 03 05:25:48.207488 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Roles: member,reader Aug 03 05:25:48.208974 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1368716392674f62bd5b38d607455955"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1368716392674f62bd5b38d607455955"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1368716392674f62bd5b38d607455955"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1368716392674f62bd5b38d607455955"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:25:48.208974 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant: tempest-VolumesNegativeTest-176959654 Aug 03 05:25:48.208974 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant-Id: 1368716392674f62bd5b38d607455955 Aug 03 05:25:48.208974 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant-Name: tempest-VolumesNegativeTest-176959654 Aug 03 05:25:48.208974 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User: tempest-VolumesNegativeTest-176959654-project Aug 03 05:25:48.208974 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Domain-Id: default Aug 03 05:25:48.208974 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Domain-Name: Default Aug 03 05:25:48.208974 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Id: 54c34855b8cc48fb9fc5febf917330a1 Aug 03 05:25:48.208974 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Name: tempest-VolumesNegativeTest-176959654-project Aug 03 05:25:48.208974 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: method: Aug 03 05:25:48.208974 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: exception: Volume 88b1a5ce-fe19-4f2b-b473-5b9233aa62af could not be found. Aug 03 05:25:48.208974 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: action_args: {'id': '88b1a5ce-fe19-4f2b-b473-5b9233aa62af'} Aug 03 05:25:48.208974 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:25:48.209918 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:25:48.209918 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 05:25:48.209918 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 05:25:48.209918 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 03 05:25:48.209918 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 03 05:25:48.209918 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 03 05:25:48.209918 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 03 05:25:48.209918 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 03 05:25:48.209918 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 03 05:25:48.209918 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 03 05:25:48.209918 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 03 05:25:48.209918 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 05:25:48.209918 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 05:25:48.209918 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 05:25:48.209918 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 05:25:48.209918 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 88b1a5ce-fe19-4f2b-b473-5b9233aa62af could not be found. (HTTP 404) (Request-ID: req-2fb2ccb8-2c66-4866-9aa9-60ab9331c2c2) Aug 03 05:25:48.209918 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:25:48.209918 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:25:48.209918 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:25:48.211147 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:25:48.211147 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 03 05:25:48.211147 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 03 05:25:48.211147 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 05:25:48.211147 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 05:25:48.211147 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 05:25:48.211147 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 05:25:48.211147 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 05:25:48.211147 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 05:25:48.211147 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 05:25:48.211147 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 05:25:48.211147 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 03 05:25:48.211147 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 03 05:25:48.211147 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 03 05:25:48.211147 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 03 05:25:48.211147 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 03 05:25:48.211147 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 03 05:25:48.211147 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 03 05:25:48.211147 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 03 05:25:48.212438 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 05:25:48.212438 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 05:25:48.212438 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 05:25:48.212438 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 05:25:48.212438 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 88b1a5ce-fe19-4f2b-b473-5b9233aa62af could not be found. Aug 03 05:25:48.212438 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:25:48.212438 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:25:48.212438 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:25:48.212438 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:25:48.212438 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:25:48.212438 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:25:48.212438 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:25:48.212438 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:25:48.212438 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 05:25:48.212438 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 05:25:48.212438 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:25:48.212438 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:25:48.212438 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 03 05:25:48.212438 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:25:48.213946 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 88b1a5ce-fe19-4f2b-b473-5b9233aa62af could not be found. Aug 03 05:25:48.213946 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:25:48.213946 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:25:48.213946 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:25:48.213946 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:25:48.213946 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:25:48.213946 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:25:48.213946 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:25:48.213946 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:25:48.213946 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 88b1a5ce-fe19-4f2b-b473-5b9233aa62af could not be found. Aug 03 05:25:48.213946 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:25:48.213946 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-f58fdb24-77c0-4bd0-ae53-cbf7cf77227c tempest-VolumesNegativeTest-176959654 tempest-VolumesNegativeTest-176959654-project] Returning 404 to user: Volume 88b1a5ce-fe19-4f2b-b473-5b9233aa62af could not be found. {{(pid=118331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:25:48.213946 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-f58fdb24-77c0-4bd0-ae53-cbf7cf77227c tempest-VolumesNegativeTest-176959654 tempest-VolumesNegativeTest-176959654-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/88b1a5ce-fe19-4f2b-b473-5b9233aa62af" status: 404 len: 109 microversion: 2.1 time: 0.036427 Aug 03 05:25:48.213946 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 581/1135] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Aug 3 05:25:48 2022] DELETE /compute/v2.1/os-volumes/88b1a5ce-fe19-4f2b-b473-5b9233aa62af => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:25:48.222889 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-99ac5b63-9173-4fb0-877f-b5307b03c353 tempest-VolumesNegativeTest-176959654 tempest-VolumesNegativeTest-176959654-project] Calling method '.version_select at 0x7f7601e730d0>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:25:48.251181 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.wsgi [None req-99ac5b63-9173-4fb0-877f-b5307b03c353 tempest-VolumesNegativeTest-176959654 tempest-VolumesNegativeTest-176959654-project] HTTP exception thrown: Volume 864cb673-2bd3-46ff-99be-9198d4a4a2e1 could not be found. Aug 03 05:25:48.253282 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-99ac5b63-9173-4fb0-877f-b5307b03c353 tempest-VolumesNegativeTest-176959654 tempest-VolumesNegativeTest-176959654-project] Request method failure captured: Aug 03 05:25:48.253282 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: request: GET /compute/v2.1/os-volumes/864cb673-2bd3-46ff-99be-9198d4a4a2e1 HTTP/1.1 Aug 03 05:25:48.253282 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Accept: application/json Aug 03 05:25:48.253282 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Accept-Encoding: identity Aug 03 05:25:48.253282 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Connection: close Aug 03 05:25:48.253282 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Content-Length: 0 Aug 03 05:25:48.253282 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Content-Type: application/json Aug 03 05:25:48.253282 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Host: 10.222.0.40 Aug 03 05:25:48.253282 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Openstack-System-Scope: None Aug 03 05:25:48.253282 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: User-Agent: python-urllib3/1.26.10 Aug 03 05:25:48.253282 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Auth-Token: gAAAAABi6gbbeSSci7J7LG4yHY4ULXwgj5AgoxjzCFGnHAIqI9554tbFsLADVd0zmsBZconHLXtOp4MfHBBpaTAxXvlk0AiG3ZhQGeZDpsjQyQJ9c4enjPPJxKkLFGYlvgI4kSJ0tfK99i_StVw13HtzUSbG9L-xP4bPjmhAFm0gSRPNZO4V8sg Aug 03 05:25:48.253282 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Domain-Id: None Aug 03 05:25:48.253282 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Domain-Name: None Aug 03 05:25:48.253282 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Identity-Status: Confirmed Aug 03 05:25:48.253282 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Is-Admin-Project: True Aug 03 05:25:48.253282 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Domain-Id: default Aug 03 05:25:48.253282 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Domain-Name: Default Aug 03 05:25:48.253282 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Id: 1368716392674f62bd5b38d607455955 Aug 03 05:25:48.253282 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Name: tempest-VolumesNegativeTest-176959654 Aug 03 05:25:48.253282 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Role: member,reader Aug 03 05:25:48.253282 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Roles: member,reader Aug 03 05:25:48.255143 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1368716392674f62bd5b38d607455955"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1368716392674f62bd5b38d607455955"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1368716392674f62bd5b38d607455955"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1368716392674f62bd5b38d607455955"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:25:48.255143 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant: tempest-VolumesNegativeTest-176959654 Aug 03 05:25:48.255143 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant-Id: 1368716392674f62bd5b38d607455955 Aug 03 05:25:48.255143 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant-Name: tempest-VolumesNegativeTest-176959654 Aug 03 05:25:48.255143 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User: tempest-VolumesNegativeTest-176959654-project Aug 03 05:25:48.255143 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Domain-Id: default Aug 03 05:25:48.255143 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Domain-Name: Default Aug 03 05:25:48.255143 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Id: 54c34855b8cc48fb9fc5febf917330a1 Aug 03 05:25:48.255143 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Name: tempest-VolumesNegativeTest-176959654-project Aug 03 05:25:48.255143 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: method: Aug 03 05:25:48.255143 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: exception: Volume 864cb673-2bd3-46ff-99be-9198d4a4a2e1 could not be found. Aug 03 05:25:48.255143 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: action_args: {'id': '864cb673-2bd3-46ff-99be-9198d4a4a2e1'} Aug 03 05:25:48.255143 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:25:48.256000 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:25:48.256000 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 05:25:48.256000 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 05:25:48.256000 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 05:25:48.256000 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 05:25:48.256000 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 05:25:48.256000 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 05:25:48.256000 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 05:25:48.256000 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 05:25:48.256000 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 05:25:48.256000 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 05:25:48.256000 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 05:25:48.256000 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 05:25:48.256000 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 05:25:48.256000 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 05:25:48.256000 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 864cb673-2bd3-46ff-99be-9198d4a4a2e1 could not be found. (HTTP 404) (Request-ID: req-87a5db50-d980-4550-be74-2b404e089f0c) Aug 03 05:25:48.256000 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:48.256000 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:25:48.256000 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:48.257201 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:25:48.257201 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 03 05:25:48.257201 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 03 05:25:48.257201 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 05:25:48.257201 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 05:25:48.257201 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 05:25:48.257201 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 05:25:48.257201 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 05:25:48.257201 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 05:25:48.257201 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 05:25:48.257201 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 05:25:48.257201 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 05:25:48.257201 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 05:25:48.257201 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 05:25:48.257201 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 05:25:48.257201 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 05:25:48.257201 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 05:25:48.257201 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 05:25:48.257201 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 05:25:48.258385 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 05:25:48.258385 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 05:25:48.258385 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 05:25:48.258385 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 05:25:48.258385 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 864cb673-2bd3-46ff-99be-9198d4a4a2e1 could not be found. Aug 03 05:25:48.258385 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:48.258385 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:25:48.258385 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:48.258385 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:25:48.258385 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:25:48.258385 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:25:48.258385 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:25:48.258385 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:25:48.258385 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 05:25:48.258385 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 05:25:48.258385 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:25:48.258385 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:25:48.258385 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 03 05:25:48.258385 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:25:48.259639 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 864cb673-2bd3-46ff-99be-9198d4a4a2e1 could not be found. Aug 03 05:25:48.259639 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:48.259639 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:25:48.259639 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:48.259639 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:25:48.259639 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:25:48.259639 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:25:48.259639 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:25:48.259639 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:25:48.259639 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 864cb673-2bd3-46ff-99be-9198d4a4a2e1 could not be found. Aug 03 05:25:48.259639 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:25:48.259639 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-99ac5b63-9173-4fb0-877f-b5307b03c353 tempest-VolumesNegativeTest-176959654 tempest-VolumesNegativeTest-176959654-project] Returning 404 to user: Volume 864cb673-2bd3-46ff-99be-9198d4a4a2e1 could not be found. {{(pid=118332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:25:48.259639 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-99ac5b63-9173-4fb0-877f-b5307b03c353 tempest-VolumesNegativeTest-176959654 tempest-VolumesNegativeTest-176959654-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/864cb673-2bd3-46ff-99be-9198d4a4a2e1" status: 404 len: 109 microversion: 2.1 time: 0.037017 Aug 03 05:25:48.259639 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 555/1136] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Aug 3 05:25:48 2022] GET /compute/v2.1/os-volumes/864cb673-2bd3-46ff-99be-9198d4a4a2e1 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:25:49.573082 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-a66a9273-c955-42bc-a21b-218d74e186d3 req-724eb5cb-6cf5-47dc-9286-ba7ccf7dd29f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adbab481-7f3a-4430-be8a-4429a6e46b4f", "tag": "747aa0a4-d518-4bbd-9bd6-84fef957148e"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:25:49.579962 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:25:49.589038 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-a66a9273-c955-42bc-a21b-218d74e186d3 req-724eb5cb-6cf5-47dc-9286-ba7ccf7dd29f service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:25:49.589038 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-a66a9273-c955-42bc-a21b-218d74e186d3 req-724eb5cb-6cf5-47dc-9286-ba7ccf7dd29f service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:25:49.603600 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-a66a9273-c955-42bc-a21b-218d74e186d3 req-724eb5cb-6cf5-47dc-9286-ba7ccf7dd29f service nova] Creating event network-changed:747aa0a4-d518-4bbd-9bd6-84fef957148e for instance adbab481-7f3a-4430-be8a-4429a6e46b4f on hv-cinder-85127 Aug 03 05:25:49.609544 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-a66a9273-c955-42bc-a21b-218d74e186d3 req-724eb5cb-6cf5-47dc-9286-ba7ccf7dd29f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042712 Aug 03 05:25:49.610688 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 582/1137] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:25:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:26:31.406679 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 05:26:31.407323 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Wed Aug 3 05:26:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 05:27:29.414648 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR oslo.messaging._drivers.impl_rabbit [-] [150ba246-7a0f-41cf-b83f-92370ea75897] AMQP server on 10.222.0.40:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 03 05:27:29.415312 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_api:SELECT=3 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:27:29.418245 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=24 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:27:29.419154 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG dbcounter [-] [118332] Writing DB stats nova_cell1:SELECT=7 {{(pid=118332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:27:29.424565 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-18ffd5ba-b501-4dab-ae3f-c2a4161d8471 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:27:29.425100 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-18ffd5ba-b501-4dab-ae3f-c2a4161d8471 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: adbab481-7f3a-4430-be8a-4429a6e46b4f] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:27:29.425804 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-8b7e6090-6233-4bf8-b31f-518dc3553c8a req-7dfabaf8-8b0c-497d-9442-1010b58fb686 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adbab481-7f3a-4430-be8a-4429a6e46b4f", "tag": "747aa0a4-d518-4bbd-9bd6-84fef957148e"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:27:29.432291 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-18ffd5ba-b501-4dab-ae3f-c2a4161d8471 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:27:29.436191 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-18ffd5ba-b501-4dab-ae3f-c2a4161d8471 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:27:29.436191 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-18ffd5ba-b501-4dab-ae3f-c2a4161d8471 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:27:29.436191 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-18ffd5ba-b501-4dab-ae3f-c2a4161d8471 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:27:29.437238 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-8b7e6090-6233-4bf8-b31f-518dc3553c8a req-7dfabaf8-8b0c-497d-9442-1010b58fb686 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:27:29.437766 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-8b7e6090-6233-4bf8-b31f-518dc3553c8a req-7dfabaf8-8b0c-497d-9442-1010b58fb686 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:27:29.450521 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-8b7e6090-6233-4bf8-b31f-518dc3553c8a req-7dfabaf8-8b0c-497d-9442-1010b58fb686 service nova] Creating event network-changed:747aa0a4-d518-4bbd-9bd6-84fef957148e for instance adbab481-7f3a-4430-be8a-4429a6e46b4f on hv-cinder-85127 Aug 03 05:27:29.456079 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-8b7e6090-6233-4bf8-b31f-518dc3553c8a req-7dfabaf8-8b0c-497d-9442-1010b58fb686 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040795 Aug 03 05:27:29.457035 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 583/1138] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:27:29.464118 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-18ffd5ba-b501-4dab-ae3f-c2a4161d8471 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: adbab481-7f3a-4430-be8a-4429a6e46b4f] Going to try to terminate instance {{(pid=118332) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:27:29.778352 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-18ffd5ba-b501-4dab-ae3f-c2a4161d8471 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "DELETE /compute/v2.1/servers/adbab481-7f3a-4430-be8a-4429a6e46b4f" status: 204 len: 0 microversion: 2.1 time: 0.365531 Aug 03 05:27:29.779208 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 556/1139] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Aug 3 05:27:29 2022] DELETE /compute/v2.1/servers/adbab481-7f3a-4430-be8a-4429a6e46b4f => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:27:29.787835 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-65001273-45c1-42dc-b0af-4c4214abe4a9 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:27:29.788547 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-65001273-45c1-42dc-b0af-4c4214abe4a9 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: adbab481-7f3a-4430-be8a-4429a6e46b4f] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:27:29.796118 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-65001273-45c1-42dc-b0af-4c4214abe4a9 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:27:29.796571 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-65001273-45c1-42dc-b0af-4c4214abe4a9 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:27:29.797547 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-65001273-45c1-42dc-b0af-4c4214abe4a9 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:27:29.797797 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-65001273-45c1-42dc-b0af-4c4214abe4a9 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:27:29.959832 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-65001273-45c1-42dc-b0af-4c4214abe4a9 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3954ab39014ef3819111a6fe8142b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c986ef0f5ea46f9b5e788aaca042b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:27:29.967893 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-65001273-45c1-42dc-b0af-4c4214abe4a9 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/adbab481-7f3a-4430-be8a-4429a6e46b4f" status: 200 len: 1578 microversion: 2.1 time: 0.184237 Aug 03 05:27:29.968470 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 584/1140] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:27:29 2022] GET /compute/v2.1/servers/adbab481-7f3a-4430-be8a-4429a6e46b4f => generated 1578 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:27:30.990289 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-8ca30d65-4127-4759-8b1e-184915ecbe35 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:27:30.990930 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-8ca30d65-4127-4759-8b1e-184915ecbe35 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: adbab481-7f3a-4430-be8a-4429a6e46b4f] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:27:31.004040 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-8ca30d65-4127-4759-8b1e-184915ecbe35 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:27:31.004501 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-8ca30d65-4127-4759-8b1e-184915ecbe35 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:27:31.005288 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-8ca30d65-4127-4759-8b1e-184915ecbe35 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:27:31.005745 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-8ca30d65-4127-4759-8b1e-184915ecbe35 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:27:31.023298 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO oslo.messaging._drivers.impl_rabbit [-] [150ba246-7a0f-41cf-b83f-92370ea75897] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 33056. Aug 03 05:27:31.142334 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-8ca30d65-4127-4759-8b1e-184915ecbe35 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3954ab39014ef3819111a6fe8142b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c986ef0f5ea46f9b5e788aaca042b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:27:31.149940 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-8ca30d65-4127-4759-8b1e-184915ecbe35 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/adbab481-7f3a-4430-be8a-4429a6e46b4f" status: 200 len: 1459 microversion: 2.1 time: 0.164042 Aug 03 05:27:31.150558 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 557/1141] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:27:30 2022] GET /compute/v2.1/servers/adbab481-7f3a-4430-be8a-4429a6e46b4f => generated 1459 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:27:31.791847 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-417bd41f-c00b-492d-b797-b2a0c37fb6e7 req-5fb4775b-90e5-46c5-978b-f09da86cbe7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adbab481-7f3a-4430-be8a-4429a6e46b4f", "name": "network-vif-deleted", "tag": "747aa0a4-d518-4bbd-9bd6-84fef957148e"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:27:31.801727 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-417bd41f-c00b-492d-b797-b2a0c37fb6e7 req-5fb4775b-90e5-46c5-978b-f09da86cbe7c service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:27:31.803510 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-417bd41f-c00b-492d-b797-b2a0c37fb6e7 req-5fb4775b-90e5-46c5-978b-f09da86cbe7c service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:27:31.815990 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-417bd41f-c00b-492d-b797-b2a0c37fb6e7 req-5fb4775b-90e5-46c5-978b-f09da86cbe7c service nova] Creating event network-vif-deleted:747aa0a4-d518-4bbd-9bd6-84fef957148e for instance adbab481-7f3a-4430-be8a-4429a6e46b4f on hv-cinder-85127 Aug 03 05:27:31.820812 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-417bd41f-c00b-492d-b797-b2a0c37fb6e7 req-5fb4775b-90e5-46c5-978b-f09da86cbe7c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032895 Aug 03 05:27:31.821438 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 585/1142] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:27:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:27:32.172001 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-dff8ebb4-9497-412e-81e0-68d0a141f87f tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:27:32.172617 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-dff8ebb4-9497-412e-81e0-68d0a141f87f tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: adbab481-7f3a-4430-be8a-4429a6e46b4f] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:27:32.179381 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-dff8ebb4-9497-412e-81e0-68d0a141f87f tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:27:32.179839 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-dff8ebb4-9497-412e-81e0-68d0a141f87f tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:27:32.180622 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-dff8ebb4-9497-412e-81e0-68d0a141f87f tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:27:32.181065 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-dff8ebb4-9497-412e-81e0-68d0a141f87f tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:27:32.249803 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-dff8ebb4-9497-412e-81e0-68d0a141f87f tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3954ab39014ef3819111a6fe8142b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c986ef0f5ea46f9b5e788aaca042b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:27:32.257514 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-dff8ebb4-9497-412e-81e0-68d0a141f87f tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/adbab481-7f3a-4430-be8a-4429a6e46b4f" status: 200 len: 1225 microversion: 2.1 time: 0.089511 Aug 03 05:27:32.258096 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 558/1143] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:27:32 2022] GET /compute/v2.1/servers/adbab481-7f3a-4430-be8a-4429a6e46b4f => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:27:33.280574 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-67dc2e3e-2b22-401b-b89d-a9ac5866a0f4 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:27:33.281286 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-67dc2e3e-2b22-401b-b89d-a9ac5866a0f4 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: adbab481-7f3a-4430-be8a-4429a6e46b4f] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:27:33.287931 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-67dc2e3e-2b22-401b-b89d-a9ac5866a0f4 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:27:33.288379 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-67dc2e3e-2b22-401b-b89d-a9ac5866a0f4 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:27:33.289134 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-67dc2e3e-2b22-401b-b89d-a9ac5866a0f4 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:27:33.289567 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-67dc2e3e-2b22-401b-b89d-a9ac5866a0f4 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:27:33.302590 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.wsgi [None req-67dc2e3e-2b22-401b-b89d-a9ac5866a0f4 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] HTTP exception thrown: Instance adbab481-7f3a-4430-be8a-4429a6e46b4f could not be found. Aug 03 05:27:33.304306 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-67dc2e3e-2b22-401b-b89d-a9ac5866a0f4 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Request method failure captured: Aug 03 05:27:33.304306 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: request: GET /compute/v2.1/servers/adbab481-7f3a-4430-be8a-4429a6e46b4f HTTP/1.1 Aug 03 05:27:33.304306 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Accept: application/json Aug 03 05:27:33.304306 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Accept-Encoding: identity Aug 03 05:27:33.304306 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Connection: close Aug 03 05:27:33.304306 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Content-Length: 0 Aug 03 05:27:33.304306 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Content-Type: application/json Aug 03 05:27:33.304306 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Host: 10.222.0.40 Aug 03 05:27:33.304306 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Openstack-System-Scope: None Aug 03 05:27:33.304306 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: User-Agent: python-urllib3/1.26.10 Aug 03 05:27:33.304306 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Auth-Token: gAAAAABi6gWSYRh4SIatsra1g2LsGgASzfpCWnbkx3mL9veL_SX6_v-A3hHe9snMK_7atxQsPVdxJ1_sB6cO9xOQtejQWbnf_VOCBB9ykLS1uCX_dbo_aSYGxu-wNzlw-Ohtd8Amkx7uh8mMMcR9FLSaZEtRipG5lMYEHcfObQ4Na4khvJvMvEc Aug 03 05:27:33.304306 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Domain-Id: None Aug 03 05:27:33.304306 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Domain-Name: None Aug 03 05:27:33.304306 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Identity-Status: Confirmed Aug 03 05:27:33.304306 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Is-Admin-Project: True Aug 03 05:27:33.304306 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Domain-Id: default Aug 03 05:27:33.304306 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Domain-Name: Default Aug 03 05:27:33.304306 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Id: 3c986ef0f5ea46f9b5e788aaca042b06 Aug 03 05:27:33.304306 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Name: tempest-TestVolumeBootPattern-134846104 Aug 03 05:27:33.304306 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Role: member,reader Aug 03 05:27:33.304306 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Roles: member,reader Aug 03 05:27:33.305794 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3c986ef0f5ea46f9b5e788aaca042b06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3c986ef0f5ea46f9b5e788aaca042b06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3c986ef0f5ea46f9b5e788aaca042b06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3c986ef0f5ea46f9b5e788aaca042b06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:27:33.305794 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant: tempest-TestVolumeBootPattern-134846104 Aug 03 05:27:33.305794 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant-Id: 3c986ef0f5ea46f9b5e788aaca042b06 Aug 03 05:27:33.305794 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant-Name: tempest-TestVolumeBootPattern-134846104 Aug 03 05:27:33.305794 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User: tempest-TestVolumeBootPattern-134846104-project Aug 03 05:27:33.305794 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Domain-Id: default Aug 03 05:27:33.305794 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Domain-Name: Default Aug 03 05:27:33.305794 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Id: ac3954ab39014ef3819111a6fe8142b7 Aug 03 05:27:33.305794 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Name: tempest-TestVolumeBootPattern-134846104-project Aug 03 05:27:33.305794 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: method: > Aug 03 05:27:33.305794 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: exception: Instance adbab481-7f3a-4430-be8a-4429a6e46b4f could not be found. Aug 03 05:27:33.305794 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: action_args: {'id': 'adbab481-7f3a-4430-be8a-4429a6e46b4f'} Aug 03 05:27:33.306659 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:27:33.306659 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:27:33.306659 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:27:33.306659 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:27:33.306659 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:27:33.306659 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:27:33.306659 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:27:33.306659 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:27:33.306659 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:27:33.306659 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:27:33.306659 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adbab481-7f3a-4430-be8a-4429a6e46b4f could not be found. Aug 03 05:27:33.306659 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:27:33.306659 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:27:33.306659 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:27:33.306659 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:27:33.306659 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:27:33.306659 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:27:33.306659 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:27:33.306659 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:27:33.306659 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:27:33.308160 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:27:33.308160 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:27:33.308160 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:27:33.308160 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:27:33.308160 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:27:33.308160 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:27:33.308160 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:27:33.308160 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adbab481-7f3a-4430-be8a-4429a6e46b4f could not be found. Aug 03 05:27:33.308160 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:27:33.308160 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:27:33.308160 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:27:33.308160 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:27:33.308160 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:27:33.308160 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:27:33.308160 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:27:33.308160 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:27:33.308160 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adbab481-7f3a-4430-be8a-4429a6e46b4f could not be found. Aug 03 05:27:33.308160 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:27:33.309478 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-67dc2e3e-2b22-401b-b89d-a9ac5866a0f4 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Returning 404 to user: Instance adbab481-7f3a-4430-be8a-4429a6e46b4f could not be found. {{(pid=118331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:27:33.309478 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-67dc2e3e-2b22-401b-b89d-a9ac5866a0f4 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/adbab481-7f3a-4430-be8a-4429a6e46b4f" status: 404 len: 111 microversion: 2.1 time: 0.029339 Aug 03 05:27:33.309478 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 586/1144] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:27:33 2022] GET /compute/v2.1/servers/adbab481-7f3a-4430-be8a-4429a6e46b4f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:27:36.626923 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-9a6078e1-a2b2-4531-92f1-2cd8fedb9a89 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:27:36.627452 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-9a6078e1-a2b2-4531-92f1-2cd8fedb9a89 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: f9d2fd48-b6b2-4952-8d15-3164c5f9635f] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:27:36.629327 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-1984d271-fee9-42e8-8112-08f4003d51fb req-50693f90-cf4e-4b75-9852-2795861b97de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9d2fd48-b6b2-4952-8d15-3164c5f9635f", "tag": "4f95730f-3cba-4151-98a6-89c74a9d9cce"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:27:36.634257 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-9a6078e1-a2b2-4531-92f1-2cd8fedb9a89 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:27:36.635310 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-9a6078e1-a2b2-4531-92f1-2cd8fedb9a89 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:27:36.636101 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-9a6078e1-a2b2-4531-92f1-2cd8fedb9a89 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:27:36.636784 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-9a6078e1-a2b2-4531-92f1-2cd8fedb9a89 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:27:36.640350 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-1984d271-fee9-42e8-8112-08f4003d51fb req-50693f90-cf4e-4b75-9852-2795861b97de service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:27:36.640901 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-1984d271-fee9-42e8-8112-08f4003d51fb req-50693f90-cf4e-4b75-9852-2795861b97de service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:27:36.653085 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-1984d271-fee9-42e8-8112-08f4003d51fb req-50693f90-cf4e-4b75-9852-2795861b97de service nova] Creating event network-changed:4f95730f-3cba-4151-98a6-89c74a9d9cce for instance f9d2fd48-b6b2-4952-8d15-3164c5f9635f on hv-cinder-85127 Aug 03 05:27:36.658431 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-1984d271-fee9-42e8-8112-08f4003d51fb req-50693f90-cf4e-4b75-9852-2795861b97de service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032663 Aug 03 05:27:36.659079 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 587/1145] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:27:36.687263 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-9a6078e1-a2b2-4531-92f1-2cd8fedb9a89 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: f9d2fd48-b6b2-4952-8d15-3164c5f9635f] Going to try to terminate instance {{(pid=118332) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:27:37.034726 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-9a6078e1-a2b2-4531-92f1-2cd8fedb9a89 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f9d2fd48-b6b2-4952-8d15-3164c5f9635f" status: 204 len: 0 microversion: 2.1 time: 0.411310 Aug 03 05:27:37.035384 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 559/1146] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Aug 3 05:27:36 2022] DELETE /compute/v2.1/servers/f9d2fd48-b6b2-4952-8d15-3164c5f9635f => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:27:37.045184 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-837d92d2-a692-454e-9b9f-dc7aaed559e7 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:27:37.045900 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-837d92d2-a692-454e-9b9f-dc7aaed559e7 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: f9d2fd48-b6b2-4952-8d15-3164c5f9635f] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:27:37.053200 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-837d92d2-a692-454e-9b9f-dc7aaed559e7 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:27:37.053665 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-837d92d2-a692-454e-9b9f-dc7aaed559e7 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:27:37.054498 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-837d92d2-a692-454e-9b9f-dc7aaed559e7 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:27:37.054970 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-837d92d2-a692-454e-9b9f-dc7aaed559e7 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:27:37.426827 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-837d92d2-a692-454e-9b9f-dc7aaed559e7 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3954ab39014ef3819111a6fe8142b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c986ef0f5ea46f9b5e788aaca042b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:27:37.435196 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-837d92d2-a692-454e-9b9f-dc7aaed559e7 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/f9d2fd48-b6b2-4952-8d15-3164c5f9635f" status: 200 len: 1580 microversion: 2.1 time: 0.394753 Aug 03 05:27:37.436034 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 588/1147] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:27:37 2022] GET /compute/v2.1/servers/f9d2fd48-b6b2-4952-8d15-3164c5f9635f => generated 1580 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:27:38.457819 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-ed5e7f17-766c-4563-acec-b12d31149caa tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:27:38.458433 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-ed5e7f17-766c-4563-acec-b12d31149caa tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: f9d2fd48-b6b2-4952-8d15-3164c5f9635f] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:27:38.465078 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-ed5e7f17-766c-4563-acec-b12d31149caa tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:27:38.465543 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-ed5e7f17-766c-4563-acec-b12d31149caa tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:27:38.466309 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-ed5e7f17-766c-4563-acec-b12d31149caa tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:27:38.466752 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-ed5e7f17-766c-4563-acec-b12d31149caa tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:27:38.683144 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-ed5e7f17-766c-4563-acec-b12d31149caa tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3954ab39014ef3819111a6fe8142b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c986ef0f5ea46f9b5e788aaca042b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:27:38.691687 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-ed5e7f17-766c-4563-acec-b12d31149caa tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/f9d2fd48-b6b2-4952-8d15-3164c5f9635f" status: 200 len: 1461 microversion: 2.1 time: 0.238132 Aug 03 05:27:38.692305 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 560/1148] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:27:38 2022] GET /compute/v2.1/servers/f9d2fd48-b6b2-4952-8d15-3164c5f9635f => generated 1461 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:27:39.083827 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-b22df232-aae8-40fa-a299-9ab03c6b72ea req-f6191820-1a26-4ebc-a020-a0a877d7bcd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9d2fd48-b6b2-4952-8d15-3164c5f9635f", "name": "network-vif-deleted", "tag": "4f95730f-3cba-4151-98a6-89c74a9d9cce"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:27:39.097140 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-b22df232-aae8-40fa-a299-9ab03c6b72ea req-f6191820-1a26-4ebc-a020-a0a877d7bcd5 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:27:39.097604 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-b22df232-aae8-40fa-a299-9ab03c6b72ea req-f6191820-1a26-4ebc-a020-a0a877d7bcd5 service nova] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:27:39.110337 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-b22df232-aae8-40fa-a299-9ab03c6b72ea req-f6191820-1a26-4ebc-a020-a0a877d7bcd5 service nova] Creating event network-vif-deleted:4f95730f-3cba-4151-98a6-89c74a9d9cce for instance f9d2fd48-b6b2-4952-8d15-3164c5f9635f on hv-cinder-85127 Aug 03 05:27:39.115235 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-b22df232-aae8-40fa-a299-9ab03c6b72ea req-f6191820-1a26-4ebc-a020-a0a877d7bcd5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035050 Aug 03 05:27:39.115930 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 589/1149] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Aug 3 05:27:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:27:39.717643 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-c32c717a-ab08-476a-81db-c66a74a4e9e3 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:27:39.718259 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-c32c717a-ab08-476a-81db-c66a74a4e9e3 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: f9d2fd48-b6b2-4952-8d15-3164c5f9635f] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:27:39.724970 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-c32c717a-ab08-476a-81db-c66a74a4e9e3 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:27:39.725423 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-c32c717a-ab08-476a-81db-c66a74a4e9e3 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:27:39.726216 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-c32c717a-ab08-476a-81db-c66a74a4e9e3 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:27:39.726656 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-c32c717a-ab08-476a-81db-c66a74a4e9e3 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:27:39.759745 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-c32c717a-ab08-476a-81db-c66a74a4e9e3 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:27:39.760214 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-c32c717a-ab08-476a-81db-c66a74a4e9e3 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:27:39.760721 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.objects.instance [None req-c32c717a-ab08-476a-81db-c66a74a4e9e3 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lazy-loading 'fault' on Instance uuid f9d2fd48-b6b2-4952-8d15-3164c5f9635f {{(pid=118332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:27:39.803652 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.policy [None req-c32c717a-ab08-476a-81db-c66a74a4e9e3 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3954ab39014ef3819111a6fe8142b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c986ef0f5ea46f9b5e788aaca042b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118332) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:27:39.812848 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-c32c717a-ab08-476a-81db-c66a74a4e9e3 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/f9d2fd48-b6b2-4952-8d15-3164c5f9635f" status: 200 len: 1231 microversion: 2.1 time: 0.099076 Aug 03 05:27:39.813443 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 561/1150] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:27:39 2022] GET /compute/v2.1/servers/f9d2fd48-b6b2-4952-8d15-3164c5f9635f => generated 1231 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:27:40.834709 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-17e3935a-7104-4927-ac52-51f5feb7f524 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:27:40.835437 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-17e3935a-7104-4927-ac52-51f5feb7f524 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: f9d2fd48-b6b2-4952-8d15-3164c5f9635f] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:27:40.842319 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-17e3935a-7104-4927-ac52-51f5feb7f524 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:27:40.842775 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-17e3935a-7104-4927-ac52-51f5feb7f524 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:27:40.843578 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-17e3935a-7104-4927-ac52-51f5feb7f524 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:27:40.844024 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-17e3935a-7104-4927-ac52-51f5feb7f524 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:27:40.857668 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.wsgi [None req-17e3935a-7104-4927-ac52-51f5feb7f524 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] HTTP exception thrown: Instance f9d2fd48-b6b2-4952-8d15-3164c5f9635f could not be found. Aug 03 05:27:40.859306 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-17e3935a-7104-4927-ac52-51f5feb7f524 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Request method failure captured: Aug 03 05:27:40.859306 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: request: GET /compute/v2.1/servers/f9d2fd48-b6b2-4952-8d15-3164c5f9635f HTTP/1.1 Aug 03 05:27:40.859306 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Accept: application/json Aug 03 05:27:40.859306 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Accept-Encoding: identity Aug 03 05:27:40.859306 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Connection: close Aug 03 05:27:40.859306 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Content-Length: 0 Aug 03 05:27:40.859306 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Content-Type: application/json Aug 03 05:27:40.859306 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Host: 10.222.0.40 Aug 03 05:27:40.859306 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Openstack-System-Scope: None Aug 03 05:27:40.859306 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: User-Agent: python-urllib3/1.26.10 Aug 03 05:27:40.859306 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Auth-Token: gAAAAABi6gWSYRh4SIatsra1g2LsGgASzfpCWnbkx3mL9veL_SX6_v-A3hHe9snMK_7atxQsPVdxJ1_sB6cO9xOQtejQWbnf_VOCBB9ykLS1uCX_dbo_aSYGxu-wNzlw-Ohtd8Amkx7uh8mMMcR9FLSaZEtRipG5lMYEHcfObQ4Na4khvJvMvEc Aug 03 05:27:40.859306 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Domain-Id: None Aug 03 05:27:40.859306 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Domain-Name: None Aug 03 05:27:40.859306 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Identity-Status: Confirmed Aug 03 05:27:40.859306 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Is-Admin-Project: True Aug 03 05:27:40.859306 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Domain-Id: default Aug 03 05:27:40.859306 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Domain-Name: Default Aug 03 05:27:40.859306 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Id: 3c986ef0f5ea46f9b5e788aaca042b06 Aug 03 05:27:40.859306 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Name: tempest-TestVolumeBootPattern-134846104 Aug 03 05:27:40.859306 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Role: member,reader Aug 03 05:27:40.859306 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Roles: member,reader Aug 03 05:27:40.861135 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3c986ef0f5ea46f9b5e788aaca042b06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3c986ef0f5ea46f9b5e788aaca042b06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3c986ef0f5ea46f9b5e788aaca042b06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3c986ef0f5ea46f9b5e788aaca042b06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:27:40.861135 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant: tempest-TestVolumeBootPattern-134846104 Aug 03 05:27:40.861135 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant-Id: 3c986ef0f5ea46f9b5e788aaca042b06 Aug 03 05:27:40.861135 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant-Name: tempest-TestVolumeBootPattern-134846104 Aug 03 05:27:40.861135 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User: tempest-TestVolumeBootPattern-134846104-project Aug 03 05:27:40.861135 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Domain-Id: default Aug 03 05:27:40.861135 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Domain-Name: Default Aug 03 05:27:40.861135 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Id: ac3954ab39014ef3819111a6fe8142b7 Aug 03 05:27:40.861135 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Name: tempest-TestVolumeBootPattern-134846104-project Aug 03 05:27:40.861135 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: method: > Aug 03 05:27:40.861135 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: exception: Instance f9d2fd48-b6b2-4952-8d15-3164c5f9635f could not be found. Aug 03 05:27:40.861135 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: action_args: {'id': 'f9d2fd48-b6b2-4952-8d15-3164c5f9635f'} Aug 03 05:27:40.862006 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:27:40.862006 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:27:40.862006 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:27:40.862006 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:27:40.862006 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:27:40.862006 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:27:40.862006 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:27:40.862006 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:27:40.862006 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:27:40.862006 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:27:40.862006 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9d2fd48-b6b2-4952-8d15-3164c5f9635f could not be found. Aug 03 05:27:40.862006 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:27:40.862006 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:27:40.862006 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:27:40.862006 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:27:40.862006 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:27:40.862006 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:27:40.862006 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:27:40.862006 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:27:40.862006 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:27:40.863467 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:27:40.863467 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:27:40.863467 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:27:40.863467 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:27:40.863467 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:27:40.863467 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:27:40.863467 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:27:40.863467 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9d2fd48-b6b2-4952-8d15-3164c5f9635f could not be found. Aug 03 05:27:40.863467 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:27:40.863467 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:27:40.863467 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:27:40.863467 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:27:40.863467 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:27:40.863467 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:27:40.863467 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:27:40.863467 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:27:40.863467 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9d2fd48-b6b2-4952-8d15-3164c5f9635f could not be found. Aug 03 05:27:40.863467 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:27:40.864713 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-17e3935a-7104-4927-ac52-51f5feb7f524 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Returning 404 to user: Instance f9d2fd48-b6b2-4952-8d15-3164c5f9635f could not be found. {{(pid=118331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:27:40.864713 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-17e3935a-7104-4927-ac52-51f5feb7f524 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/f9d2fd48-b6b2-4952-8d15-3164c5f9635f" status: 404 len: 111 microversion: 2.1 time: 0.030854 Aug 03 05:27:40.864713 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 590/1151] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:27:40 2022] GET /compute/v2.1/servers/f9d2fd48-b6b2-4952-8d15-3164c5f9635f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:27:41.355509 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-4e91d52a-8cd9-4621-931e-cdc57026a101 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:27:41.356029 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.compute.api [None req-4e91d52a-8cd9-4621-931e-cdc57026a101 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: 64b183db-1997-4a33-9bb9-40d05791a321] Fetching instance by UUID {{(pid=118332) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:27:41.362587 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-4e91d52a-8cd9-4621-931e-cdc57026a101 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:27:41.363100 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-4e91d52a-8cd9-4621-931e-cdc57026a101 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:27:41.363910 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-4e91d52a-8cd9-4621-931e-cdc57026a101 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:27:41.364358 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG oslo_concurrency.lockutils [None req-4e91d52a-8cd9-4621-931e-cdc57026a101 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:27:41.377722 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.wsgi [None req-4e91d52a-8cd9-4621-931e-cdc57026a101 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] HTTP exception thrown: Instance 64b183db-1997-4a33-9bb9-40d05791a321 could not be found. Aug 03 05:27:41.379445 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-4e91d52a-8cd9-4621-931e-cdc57026a101 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Request method failure captured: Aug 03 05:27:41.379445 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: request: DELETE /compute/v2.1/servers/64b183db-1997-4a33-9bb9-40d05791a321 HTTP/1.1 Aug 03 05:27:41.379445 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Accept: application/json Aug 03 05:27:41.379445 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Accept-Encoding: identity Aug 03 05:27:41.379445 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Connection: close Aug 03 05:27:41.379445 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Content-Length: 0 Aug 03 05:27:41.379445 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Content-Type: application/json Aug 03 05:27:41.379445 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Host: 10.222.0.40 Aug 03 05:27:41.379445 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Openstack-System-Scope: None Aug 03 05:27:41.379445 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: User-Agent: python-urllib3/1.26.10 Aug 03 05:27:41.379445 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Auth-Token: gAAAAABi6gWSYRh4SIatsra1g2LsGgASzfpCWnbkx3mL9veL_SX6_v-A3hHe9snMK_7atxQsPVdxJ1_sB6cO9xOQtejQWbnf_VOCBB9ykLS1uCX_dbo_aSYGxu-wNzlw-Ohtd8Amkx7uh8mMMcR9FLSaZEtRipG5lMYEHcfObQ4Na4khvJvMvEc Aug 03 05:27:41.379445 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Domain-Id: None Aug 03 05:27:41.379445 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Domain-Name: None Aug 03 05:27:41.379445 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Identity-Status: Confirmed Aug 03 05:27:41.379445 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Is-Admin-Project: True Aug 03 05:27:41.379445 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Domain-Id: default Aug 03 05:27:41.379445 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Domain-Name: Default Aug 03 05:27:41.379445 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Id: 3c986ef0f5ea46f9b5e788aaca042b06 Aug 03 05:27:41.379445 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Project-Name: tempest-TestVolumeBootPattern-134846104 Aug 03 05:27:41.379445 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Role: member,reader Aug 03 05:27:41.379445 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Roles: member,reader Aug 03 05:27:41.380913 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3c986ef0f5ea46f9b5e788aaca042b06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3c986ef0f5ea46f9b5e788aaca042b06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3c986ef0f5ea46f9b5e788aaca042b06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3c986ef0f5ea46f9b5e788aaca042b06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:27:41.380913 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant: tempest-TestVolumeBootPattern-134846104 Aug 03 05:27:41.380913 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant-Id: 3c986ef0f5ea46f9b5e788aaca042b06 Aug 03 05:27:41.380913 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-Tenant-Name: tempest-TestVolumeBootPattern-134846104 Aug 03 05:27:41.380913 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User: tempest-TestVolumeBootPattern-134846104-project Aug 03 05:27:41.380913 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Domain-Id: default Aug 03 05:27:41.380913 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Domain-Name: Default Aug 03 05:27:41.380913 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Id: ac3954ab39014ef3819111a6fe8142b7 Aug 03 05:27:41.380913 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: X-User-Name: tempest-TestVolumeBootPattern-134846104-project Aug 03 05:27:41.380913 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: method: > Aug 03 05:27:41.380913 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: exception: Instance 64b183db-1997-4a33-9bb9-40d05791a321 could not be found. Aug 03 05:27:41.380913 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: action_args: {'id': '64b183db-1997-4a33-9bb9-40d05791a321'} Aug 03 05:27:41.381695 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:27:41.381695 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:27:41.381695 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:27:41.381695 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:27:41.381695 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:27:41.381695 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:27:41.381695 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:27:41.381695 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:27:41.381695 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:27:41.381695 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:27:41.381695 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64b183db-1997-4a33-9bb9-40d05791a321 could not be found. Aug 03 05:27:41.381695 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:27:41.381695 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:27:41.381695 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:27:41.381695 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:27:41.381695 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:27:41.381695 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:27:41.381695 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:27:41.381695 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:27:41.381695 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:27:41.383023 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:27:41.383023 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 05:27:41.383023 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 05:27:41.383023 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 05:27:41.383023 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 05:27:41.383023 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:27:41.383023 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:27:41.383023 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:27:41.383023 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:27:41.383023 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64b183db-1997-4a33-9bb9-40d05791a321 could not be found. Aug 03 05:27:41.383023 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:27:41.383023 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:27:41.383023 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:27:41.383023 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:27:41.383023 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:27:41.383023 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:27:41.383023 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:27:41.383023 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:27:41.383023 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64b183db-1997-4a33-9bb9-40d05791a321 could not be found. Aug 03 05:27:41.383023 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: ERROR nova.api.openstack.wsgi Aug 03 05:27:41.384325 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-4e91d52a-8cd9-4621-931e-cdc57026a101 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Returning 404 to user: Instance 64b183db-1997-4a33-9bb9-40d05791a321 could not be found. {{(pid=118332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:27:41.384325 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-4e91d52a-8cd9-4621-931e-cdc57026a101 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "DELETE /compute/v2.1/servers/64b183db-1997-4a33-9bb9-40d05791a321" status: 404 len: 111 microversion: 2.1 time: 0.029955 Aug 03 05:27:41.384325 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 562/1152] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Aug 3 05:27:41 2022] DELETE /compute/v2.1/servers/64b183db-1997-4a33-9bb9-40d05791a321 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:27:41.389619 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-875a2a87-cd9d-4424-bb7d-27f63bb10696 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:27:41.390234 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-875a2a87-cd9d-4424-bb7d-27f63bb10696 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] [instance: 64b183db-1997-4a33-9bb9-40d05791a321] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:27:41.396260 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-875a2a87-cd9d-4424-bb7d-27f63bb10696 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:27:41.396721 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-875a2a87-cd9d-4424-bb7d-27f63bb10696 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:27:41.397489 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-875a2a87-cd9d-4424-bb7d-27f63bb10696 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:27:41.397931 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-875a2a87-cd9d-4424-bb7d-27f63bb10696 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Lock "e4c70b33-dcef-4553-8910-fe7fe241a76c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:27:41.411475 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.wsgi [None req-875a2a87-cd9d-4424-bb7d-27f63bb10696 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] HTTP exception thrown: Instance 64b183db-1997-4a33-9bb9-40d05791a321 could not be found. Aug 03 05:27:41.412978 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-875a2a87-cd9d-4424-bb7d-27f63bb10696 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Request method failure captured: Aug 03 05:27:41.412978 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: request: GET /compute/v2.1/servers/64b183db-1997-4a33-9bb9-40d05791a321 HTTP/1.1 Aug 03 05:27:41.412978 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Accept: application/json Aug 03 05:27:41.412978 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Accept-Encoding: identity Aug 03 05:27:41.412978 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Connection: close Aug 03 05:27:41.412978 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Content-Length: 0 Aug 03 05:27:41.412978 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Content-Type: application/json Aug 03 05:27:41.412978 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Host: 10.222.0.40 Aug 03 05:27:41.412978 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Openstack-System-Scope: None Aug 03 05:27:41.412978 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: User-Agent: python-urllib3/1.26.10 Aug 03 05:27:41.412978 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Auth-Token: gAAAAABi6gWSYRh4SIatsra1g2LsGgASzfpCWnbkx3mL9veL_SX6_v-A3hHe9snMK_7atxQsPVdxJ1_sB6cO9xOQtejQWbnf_VOCBB9ykLS1uCX_dbo_aSYGxu-wNzlw-Ohtd8Amkx7uh8mMMcR9FLSaZEtRipG5lMYEHcfObQ4Na4khvJvMvEc Aug 03 05:27:41.412978 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Domain-Id: None Aug 03 05:27:41.412978 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Domain-Name: None Aug 03 05:27:41.412978 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Identity-Status: Confirmed Aug 03 05:27:41.412978 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Is-Admin-Project: True Aug 03 05:27:41.412978 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Domain-Id: default Aug 03 05:27:41.412978 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Domain-Name: Default Aug 03 05:27:41.412978 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Id: 3c986ef0f5ea46f9b5e788aaca042b06 Aug 03 05:27:41.412978 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Project-Name: tempest-TestVolumeBootPattern-134846104 Aug 03 05:27:41.412978 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Role: member,reader Aug 03 05:27:41.412978 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Roles: member,reader Aug 03 05:27:41.414705 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3c986ef0f5ea46f9b5e788aaca042b06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3c986ef0f5ea46f9b5e788aaca042b06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3c986ef0f5ea46f9b5e788aaca042b06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3c986ef0f5ea46f9b5e788aaca042b06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Aug 03 05:27:41.414705 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant: tempest-TestVolumeBootPattern-134846104 Aug 03 05:27:41.414705 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant-Id: 3c986ef0f5ea46f9b5e788aaca042b06 Aug 03 05:27:41.414705 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-Tenant-Name: tempest-TestVolumeBootPattern-134846104 Aug 03 05:27:41.414705 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User: tempest-TestVolumeBootPattern-134846104-project Aug 03 05:27:41.414705 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Domain-Id: default Aug 03 05:27:41.414705 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Domain-Name: Default Aug 03 05:27:41.414705 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Id: ac3954ab39014ef3819111a6fe8142b7 Aug 03 05:27:41.414705 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: X-User-Name: tempest-TestVolumeBootPattern-134846104-project Aug 03 05:27:41.414705 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: method: > Aug 03 05:27:41.414705 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: exception: Instance 64b183db-1997-4a33-9bb9-40d05791a321 could not be found. Aug 03 05:27:41.414705 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: action_args: {'id': '64b183db-1997-4a33-9bb9-40d05791a321'} Aug 03 05:27:41.416165 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:27:41.416165 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:27:41.416165 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:27:41.416165 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:27:41.416165 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:27:41.416165 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:27:41.416165 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:27:41.416165 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:27:41.416165 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:27:41.416165 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:27:41.416165 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64b183db-1997-4a33-9bb9-40d05791a321 could not be found. Aug 03 05:27:41.416165 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:27:41.416165 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:27:41.416165 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:27:41.416165 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:27:41.416165 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:27:41.416165 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:27:41.416165 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:27:41.416165 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:27:41.416165 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:27:41.417720 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:27:41.417720 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:27:41.417720 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:27:41.417720 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:27:41.417720 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:27:41.417720 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:27:41.417720 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:27:41.417720 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64b183db-1997-4a33-9bb9-40d05791a321 could not be found. Aug 03 05:27:41.417720 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:27:41.417720 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:27:41.417720 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:27:41.417720 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:27:41.417720 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:27:41.417720 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:27:41.417720 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:27:41.417720 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:27:41.417720 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64b183db-1997-4a33-9bb9-40d05791a321 could not be found. Aug 03 05:27:41.417720 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Aug 03 05:27:41.419346 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-875a2a87-cd9d-4424-bb7d-27f63bb10696 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Returning 404 to user: Instance 64b183db-1997-4a33-9bb9-40d05791a321 could not be found. {{(pid=118331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:27:41.419346 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-875a2a87-cd9d-4424-bb7d-27f63bb10696 tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "GET /compute/v2.1/servers/64b183db-1997-4a33-9bb9-40d05791a321" status: 404 len: 111 microversion: 2.1 time: 0.028762 Aug 03 05:27:41.419346 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 591/1153] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Aug 3 05:27:41 2022] GET /compute/v2.1/servers/64b183db-1997-4a33-9bb9-40d05791a321 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:27:42.874164 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: DEBUG nova.api.openstack.wsgi [None req-f31d0d1c-2636-40f3-b744-dd4b2a4ba35b tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] Calling method '.version_select at 0x7f7601da35e0>' {{(pid=118332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:27:42.955600 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO nova.api.openstack.requestlog [None req-f31d0d1c-2636-40f3-b744-dd4b2a4ba35b tempest-TestVolumeBootPattern-134846104 tempest-TestVolumeBootPattern-134846104-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1057909603" status: 202 len: 0 microversion: 2.1 time: 0.085291 Aug 03 05:27:42.956186 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: [pid: 118332|app: 0|req: 563/1154] 10.222.0.40 () {58 vars in 1263 bytes} [Wed Aug 3 05:27:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1057909603 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:27:57.973475 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 05:27:57.974035 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Wed Aug 3 05:27:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 05:29:51.415065 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 05:29:51.415713 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Wed Aug 3 05:29:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 05:30:10.026880 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 05:30:10.027457 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Wed Aug 3 05:30:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 05:31:17.981844 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 05:31:17.985060 dv-cinder-851279-4-iscsi devstack@n-api.service[118331]: Wed Aug 3 05:31:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 05:33:00.137621 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 05:33:00.138245 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Wed Aug 3 05:33:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 05:33:11.423522 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 05:33:11.424123 dv-cinder-851279-4-iscsi devstack@n-api.service[118332]: Wed Aug 3 05:33:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!